1/2 


AD-A188  780  AN  ANAL V? 1 5  OF  FRIENDLV  NNPUT  DEVICES  FOR  THE  CONTROL 
OF  THE  NAVAL  UARFAR  (U)  NAVAL  POSTGRADUATE  SCHOOL 
NONTEREV  CA  M  J  SUEENEV  ET  AL  HAR  88 


UNCLASSIFIED 


F/G  5/5 


NL 


|gar:nmTOiiJ<:M.Pi.Tjmatw 


REPORT  DOCUMENTATION  PAGE 


lb.  RESTRICTIVE  MARKINGS 


:LR  'v  Ci.*5S:r-fA7iON  AUTHORITY 


|  2b.  OECLASS-fiCATIGN/  DOWNGRAD'NG  SCHEDULE 


3  DISTRIBUTION  /AVAILABILITY  OF  REPORT 

Approved  for  public  release;  distribution 
is  unlimited. 


S  MONITORING  ORGANIZATION  REPORT  NUMBERS) 


6a.  NAME  OF  PERFORMING  ORGANIZATION 


Naval  Postgraduate  School 


Sc.  ADDRESS  (C/fy,  Stare,  and  ZIP  Code) 

Monterey,  California  93945-5000 


6b  OFFICE  SYMBOL 

(If  applicable) 

Code  54 


7a.  NAME  OF  MONITORING  ORGANIZATION 

Naval  Postgraduate  School _ 

7b  ADDRESS  (City,  State,  and  ZIP  Code) 

Monterey,  California  93943-50 00 


3a  NAME  OF  FUNDING /SPONSORING 
ORGANIZATION 


8b.  OFFICE  SYMBOL  I  9  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUM8ER 
(If  applicable)  I 


1  10  SOURCE  OF  FUNDING  NUMBER 

S 

PROGRAM 
ELEMENT  NO. 

PROJECT 

NO 

TASK 

NO 

WORK  UNIT 
ACCESSION  NO 

8c  AOORESS  (City,  State,  and  ZIP  Code) 


'  1  title  (Include  Security  Classification ) 

AN  ANALYSIS  OF  FRIENDLY  INPUT  DEVICES  FOR  THE  CONTROL  OF  THE  NAVAL  WARFARE  INTERACTIVE 
SIMULATION  SYSTEM  (NWISS)  _ _ 


•2  PERSONAL  AUTHOR(S) 

Sweenev,  Mark  J.  and  Bitar,  Kenneth  J 


•3a  TYPE  OF  REPORT 

Master's  Thesis 


13b  TIME  COVERED 
FROM  _  TO 


14  DATE  OF  REPORT  (Year.  Month.  Day)  IS  PAGE  COUNT 

1986  March  124 


_ _ COSATI  CODES _ I  18  SUBJECT  TERMS  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

I  group  f  sub-group  |  Voice,  Keyboard,  Pull-down  Window  Evaluations 


'9  ABSTRACT  ( Continue  on  reverse  if  necessary  and  identity  by  block  number) 

This  thesis  describes  an  experiment  conducted  at  the  Naval  Postgraduate  School  (NPS) 
during  the  period  15  October  through  28  October  1985.  Specifically,  the  experiment  evalu¬ 
ates  "pull-down  window"  microcomputer  technology,  continuous  speech  recognition  equipment, 
and  standard  computer  keyboard  entry  to  input  commands  in  a  command  and  control  environ¬ 
ment.  Using  the  Naval  Warfare  Interactive  Simulation  System  (NWISS)  as  a  controlled 
medium,  military  problems  were  posed  to  test  subjects  in  specific  light  and  noise 
environments. 

Although  the  results  are  not  entirely  conclusive,  they  do  demonstrate  a  distinct 
advantage  in  using  continuous  speech  or  keyboard  entry  modes  over  the  drop-down  window 
technology  of  the  Macintosh  (if  subject  training  time  is  not  a  significant  restriction). 
Either  the  continuous  speech,  or  the  keyboard  method  was  clearly  superior  in  all  environ¬ 
ments.  x 


;o  Distribution/ availability  of  abstract 
EuNCLASSIFIEO/UNLIMITEO  □  SAME  AS  RPT 


22a  NAME  OF  RESPONSIBLE  INDIVIDUAL 


ll«Kl^  ilil 


OO  FORM  1473,84  mar 


ACT  121  ABSTRACT  SECURITY  CLASSIFICATION 

AS  RPT  □  OTIC  USERS  I  I 


22b  TELEPHONE  (Include  Area  Code)  22c  OFFICE  SYMBOL 

/ i noi 646- 2493  55S 


83  APR  edition  nn*y  b«  used  until  exhausted  SECURITY  CLASSIFICATION  OF  '’his  PAGE 

All  oth«r  editions  arc  obsolete 


■  *  -  *  *  - 


App-rovec  for  public  release;  oistribution  is  unlimited 


Ar.  Analysis  of  Frienciy  Input  Devices  for  toe  Control  of  trie 
.'Java!  Warfare  Interactive  Simulation  System  (KV.-ISS) 


c-y 


Warn  J.  Sweeney 

Lieutenant  Co;..:-. oncer .  Uniteu  States  i.'avy 
B.3.,  Uniteu  States  Uaval  Acacerr.y,  1974 

anci 


Kenneth  J.  Pitar 
Lieutenant.  Unitea  States  Uavy 
B.S..  Cklahorr.a  City  University.  1577 


Submitted  in  partial  fulfillment  of  the 
requirements  for  the  decree  of 

MASTER  OF  SCIENCE  IN  INFORMATION  SYSTEMS 

from  the 

NAVAL  POSTGRADUATE  SCHOOL 
March  1986 


Author : 

Author : 

Approvea  by: 


7~C 


Lyons.  Cc-Advisor 


W.P.  Greer.  Jr.»  Chairnar. 
Department  cf  Atiministgat j. ve  Sciences 

. . yUfeMlJd 


Kneaie  T.  MarStvaj. ±  .. 
Dear;  of  Information  and  PoTrcv 


sciences 


ABSTRACT 


T zi  ft:ir  Ascribes  an  experir.  ent  coruiuct.ee  at  the  have* 
Pcs  t .  rSuUctft  School  ourin..  the  period  15  October  1 

*.  *  ■  r  o  u  0  h  c  *.  •  oct  jutr  1  5  c  5  .  ccificoiiy*  t  r .  e  e  x  p  e  r  1 1.  e  r  t  o  v  i .  i.  j  t. 

"pull-down  v.indow"  n  icrocorr.puter  technology,  continuous  spcecn 
recognition  equipment,  ana  standard  computer  keyboard  entry  to 
input  commands  in  a  command  and  control  environment.  Using  the 
Naval  Warfare  Interactive  Simulation  System  (NWISS)  as  a  controlled 
medium,  military  problems  were  posed  to  test  subjects  in  sped  t  ic 
light  and  noise  environments. 

Although  the  results  are  not  entirely  conclusive,  they  cc 
demonstrate  a  distinct  advantage  in  using  continuous  speech  or 
keyboard  entry  modes  over  the  drop-down  wirdow  technology  of  trie 
Macintosh  (if  subject  training  time  is  not  a  significant  restric¬ 
tion).  Either  the  continuous  speech,  or  the  keyboard  method  was 
clearly  superior  in  all  environments. 
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A.  OVERVIEW 


Jcr.pjts.-r  Tecrroio^y  has  ire  reused  exponentially  ever  •.  re  r. 

several  years.  As  a  result,  work  is  now  coin.  co.  j.-  i  1 1 
:  f :  :  c  :  e  r  r. i y  a n  A  i  r  e :<  pensively  th a r;  e  v e r  t e fo re.  ..  v r ;.s  e;-.:  . 
faced  with  a  myriad  oi  available  computer  options,  it  cehocves 
the  individual  user  to  choose  one  that  is  not  only  user  frier.ulv , 
but  is  both  cost  effective  and  a  proven  performer.  Time  r as 
always  been  a  critical  factor  for  ary  business,  and  people  are 
now  realizing  that  using  a  computer  only  constitutes  tre  first 
step  toward  achieving  reductions  ir.  this  area. 

In  recent  years  there  has  been  a  mover;  ent  afoot  to  simplify 
the  all  important  man-machine  interface  which  counts  sc  , -cavil y 
in  on-line  efficiency  computations.  While  the  computer  keyboard 
has  long  been  the  industry  standard,  its  speed  is  severely  1  j  r.  itec 
by  the  skill/training  of  the  user;  and  the  subject's  knowledge  of 
the  particular  command  keys.  Due  primarily  to  these  recognizee 
limitations,  more  attention  is  being  paid  to  a  faster,  arc.  ..ore 
sophisticated  means  of  communication  between  user  arm  machine : 
Automatic  Speed.  Recognition  (A SR).  This  concept  was  first  introduced 
in  trie  late  1950’s,  anc;  significant  progress  was  made  witi.ir  tre 
last  15  years.  It  is  k  r.  cur;  that  free  speecn,  in  its  natural 
form,  is  the  fastest  and  most  economical  means  for  homo  sapiens 
to  communicate  amongst  themselves.  Applying  this  fact  tc  tre 
user-rr.achi  re  interface  dilemma  •  it  has  oee-r  shown  that  macnines 
car:  not  only  be  taught  to  r  e  s p c ri o  t c  any  language,  out  t : . a  t 


speech  ror  tins  type  of  comrunicat icn  leaves  the  user's  bancs  arc. 


reet  tree  in  order  to  perforir  important  concurrent  functions 
(i.e.,  viewing  crannies  screens  cr  cecision  support  aids,  cerscr.rel 
interface,  etc.).  v.'hile  admittedly  the  procress  toward  an  eccncr.  - 
ically  fees  icxe  voice  recognition  system,  has  been  slew,  ar;. 
prooucts  are  now  making  themselves  known  in  industrial,  military 
ano  security-orientec  applications.  It  is  this  encou racino  trenu, 
coupled  with  the  significant  accomplishments  in  each  area  of  use 
that  leads  researchers  to  believe  in  its  unlimited  potential. 
[Ref.  1  and  2] 

The  newest  development  in  interface  technology  is  the  "pull-cown 
wincow"  incorporated  in  the  Macintosh  microcor;.puter .  (See  Enclosures 
1-G  in  Appendix  G.)  This  methodology,  in  conjunction  with  the  use 
of  a  mouse  peripheral  input  device,  presents  a  " rectangular-sriapec 
menu"  on  a  computer  screen  within  which  the  user  writes  ano  reads 
data  representing  a  program  in  the  computer.  Because  the  mover ent 
of  the  cursor  matches  the  movement  of  the  mouse,  the  user  r.ecc 
only  place  the  cursor  on  the  oesireo  command  ano  press  a  conveniently 
located  button  for  instant  activation.  Although  no  comparisons 
( incividually  cr  collectively)  have  currently  been  race  with  the 
more  traditional  interface  devices  because  of  its  recent  emergence 
in  tno  marketplace,  its  ease  of  use  anc  efficient  operation  near 
true  witness  to  its  untapped  possibilities.  [Ref.  3) 

This  thesis  is  concerned  with  evaluating  the  speec,  accuracy 
and  efficiency  of  the  three  previously  described  input  devices. 
The  data  gathered  for  analysis  was  cenerateo  by  subjects 


articigatir.,.  m  an  e?:|.er  i.;er<t  usirc  tr.e  ..aval  ..an  are  interactive 
mu  1  a  t  i  o  r.  Systtr::  ( bh'ISS)  ,  and  will  be  discussea  in  cetsj  2  i: 
later  sections. 

B.  SCOPE  OF  THE  THESIS 

j:  1 1. i.ou h  numerous  exteri:.  erts  concerning  automatic 
recognition  have  been  conducted  at  the  .‘.'aval  Feature  cut  be  .1  c,  c '  _ 
( :iPS )  >  Icnterey,  California,  only  one  previous  experiment  (conducts, 
by  V, right  ana  Hanson ;  two  I, PS  * r a o u a t e  students  )  has  attei.ipt.ee  i 
conprerer.si  ve  evaluation  of  computer  input  technologies  ir  a 
military  cor  mand  and  control  environment.  That  experiment  w a z  to', 
first  attempt  to  evaluate  two  voice  recognition  systems  of  di  f  fer  ir 
technologies ,  besides  the  core  conventional  Keyboard  ( typin;  J 
mode  of  input.  [Hef.  2] 

Accepting  the  conclusions  drawn  in  the  V/right/Hanscri  thesis  a: 
a  basic  premise,  the  Discrete  Voice  System  (Threshold)  was  eliminates 
as  a  possible  candidate  for  further  experimentation.  This  decisior 
was  based  on  its  record  of  poor  performance  ir.  the  experir.  out , 
ar.o  the  requirer.  trt  of  a  discrete  system  to  speak  i  n  brewer 
pi. rases  which  is  unnatural  and  cumbersome  to  human  beings  ir 
general.  Since  the  keyboard  was  highly  successful  as  an  input 
r.  odium  in  the  previous  experiment ,  the  results  were  useu  as  j 
thira  comparison  against,  the  two  newer  mediums  selectee  in  tn  i  s 
experiment,  because  the  l,'ribht/!ianson  experiment  usee  (.ft.  •. 

M.'ISS  war^aming  scenarios,  it  was  not  only  unnecessary  to  repeat 
trie  procedure,  but  it  allowed  for  tore  concentration  or.  tic 
exploitation  of  the  possibilities  present  ir,  the  "newer  metis". 


_ waste  purpose  ci  experi:. er.t  was  u;  evi.ijc.pe  ui :  i  *rv  r  t. 

input  interfaces  to  trie  Xhld  war_ar;.e  scenarios  resiu.-rt  •_ 

~  i  _  i  t.  ai  Ec  u  i  pme  r  t  Corporation's  V  A  X  11/7  •  C  co:  i.ur.  savin 


selectee  the  su  rear  late  incut  meal  a  (i, 


ti.e  .  ac  i  :  t.c. .  icrc 


co. ..cuter  Ai*.::  crop-ccvr:  vir.ucw  leccnolc  r_y  .  t;.<:  77:  ‘  !  w  u:  . 

•..its:  Automatic  Speech  Recognition  capability  a  no  Zi  «  per  ip  u  rd 
icey  board  a ttachec  to  the  VAX  computer),  it  was  necessary  ta 
establish  certain  measures  of  Effectiveness  (hCE's)  or  wden  t.c 
base  the  ensuin'  comparisons.  It  was  beciced  that  the  nuder  of 
commands  entered  during  one  i.'V.'ISS  wargan  i rig,  session  wouic  be  t..t 
prirrary  MCE.  This  coupled  with  the  numoer  of  Control_X’s  (entry 
errors  mace  by  the  user)  entered  would  provide  the  necessary  cats 
in  which  to  answer  the  following  questions:  1)  Was  any  ays  tot 
tore  effective,  and  or  easier  to  use?;  2)  V.’as  any  syst.ei.  ;  mm 
effective  under  the  varied  environmental  conditions?,  arc:  1)  ’..'us 
a  clear  learning  curve  established  as  a  result  of  more  practice 
with  a  particular  input  device? 

This  thesis  will  not  induce  a  description  of  the  construction 
process  used  to  devise  trie  warguming  scenarios,  or  provide  t.e 
methodology  used  to  build  tne  operating  system;  since  they  ootn 
already  exist.  Additionally,  the  development  of  the  VAX  1 1/7 so 
and  the  resident  NWISS  is  already  complete  anu  will  r.ot  be  discusses. 
All  conclusions  from  tne  experiment  ar.c.  the  author '  s  recommendations 
for  foilov/-ori  ex  peri  mentation /study  succeeds  the  analysis  oi 
data,  and  will  provide  seme  insight  for  the  future  use  cf  t.  is 
burgeoning  tocnnology . 


C.  SUMMARY 


This  thesis  comprises  a  cescripticn  of  the  initial  experiment , 
including  ail  procedures  and  cac/.^rcund  material  precto;  i.  its 
inception.  A  summary  of  casic  speech  recc^r.  iton  tec  n  no .  o .  ;  . 
Macintosh  ri  icrcccr.  outer  tecnnoloty  and  a  review  of  past  exper  i....  ;  ts 
witt;  spc-ecr.  recognition  at  I.'FS  is  providec  in  Chapters  II  a r.c 

III.  The  design  process  for  this  experiment  (i.e..  design  of  the 
scenarios,  determination  of  environii.ents .  background  of  the 
subjects,  and  practice/training  sessions)  is  given  in  Cnapters 

IV,  V  and  VI.  Analysis  of  the  data  from  the  experiment  is  provided 
in  Chapter  VII.  All  experiment  conclusions  and  the  authors’ 
recommendations  for  further  study/applications  follow  the  analysis 
cf  data  section. 

Appendices  F  and  C-  provide  detailed  guidance  for  follow-on 
experiments  using  Vertex  3000  or  Macintosh  microcomputer  technology, 
respectively. 


tlK»] 


Tr.t;  l  se  c:  Continuous  Speech  !>eco  :,r:iticr  Sy  ute:.  s  r.ar  e 
s  i  _  r  i f  i  c  2 ::  r.  I  ■  o  v  •.?  r  toe  past  t.  re-  tc  ;'ive  ye-:,  rc.  .-.ftcr 

i  r  _  '..‘its  oiscrt-:e  systems  ,  .'.SR  is  ro;  cem  tr..  - 

oucec  for  use  in  critical  areas  of  operation.  Tie  progress  ..ate 
in  recent:  years  is  xeasureci  in  .-..any  different  v.  ays.  Ire  e ..  t 
obvious  is  ti.e  performance  aric  capabilities  of  the  machine.  Seme 
cf  the  other  criteria,  however,  are  equally  important.  loess 
would  include  increased  vocabulary  size,  distinguisi in^  between 
easily  confusing  woros  anc  minimizing  trie  effects  of  noise  and 
other  interfaces.  This  cnapter  will  discuss  some  cf  the  tt.eory 
tehird  Continuous  Speech  Recognition  Systems. 


B.  DEFINITION  OF  TERMS 

The  real  meaning  of  speech  recognition  may  see:.,  intuitive, 
but  its  derivation  and  appropriate  applications  will  be  describee 
further  to  preclude  possible  confusion,  and  to  provioe  a  common 
base  for  universal  under  stand  in/,. 

Speech  Recognition  can  be  defined  as  the  process  of  trans¬ 
ferring,  the  continuous  acoustic  speech  symbol  into  discrete 
representations.  These  symbols  nay  be  assigned  proper  meanings, 
anc  when  comprehended ,  may  be  usee  to  affect  responsive  behavior. 
The  next  major  distinction  is  made  between  Connected  (Continuous) 
Speech,  or  Isolated  (Discrete)  Speech.  Connected  Speech  is  that 
in  which  there  are  no  significant  pauses.  £n  example  would  be  a 


1  4 


$ 


K  ■ 


K 


i*r ntt-nce  3;:o.:en  at  a  r.crr.  ai  rate.  It  is  a  difficult  tat.-.  ;  v  r 
computers  to  oistini.uisr.  between  where  or.e  v.oro  t.:..s,  c.r:u  tie 
next  ucrci  begins.  I  sole,  ted  speecn  dees  not  have  tx.tr.  pro  sir:.  . 
since  significant  pauses  (  i  .  e .  •  Tor  r.--Latue--Cr. )  are  s  :  ter.  r.nct  ... 
to  a.  i  o'.-,  at  stinc  tier:.  The  "ectt&r.-ii  re"  oca.  c:  _■.;.  cn 
ays  ten.  is  to  rapidly  ar.c  accurately  interpret  tte  user's  input . 
ond  then  select  ar.c  respond  appropriately.  There-  is  no  court 
that  it  is  easier  to  rake  computers  recognize  worts  sec,.en 


isolation,  or  at  worst,  spoken  in  broken  phrases.  Ir.  fact,  there 
are  several  exan.pies  of  this  on  the  market  today.  3y  t re  same 
token,  however,  speakirg  with  isolated  words  or  broken  phrases  is 
difficult  for  humans  to  achieve,  and  Fence  not  desirable.  [Ref.  A 
and  5  ] 


C.  CONTINUOUS  SPEECH  RECOGNITION  BACKGROUND 


As  the  cost  cf  equipment  declines.  Continuous  Voice  Systems 
are  receiving  incressec  attention.  Concentrated  researen  started 
in  1971  when  the  Advancea  Research  Project  Agency  (DARFA)  of  the 
Department  of  Defense  allocated  $15  million  dollars  beware  a 
program  called  Speech  Understanding  Research  (SUK).  It  was  tne 
largest  single  project  ever  undertaken  in  speech  recognition,  ana 
succeedec  ir  developing  machines  that  were  capable  of  "understanding" 
continuously-spoken  sentences  involving  a  1000-word  vocabulary. 
[Ref.  6]  Although  the  DARPA  project  was  not  the  first,  to  research 
continuous  speech  recognition,  it  spawned  the  ideas  of  several 
other  companies  who  followed  suit  shortly  thereafter. 


The  7AKF-  project  came  to  ar.  etw  i r.  1976  with  s  lcruv-a:. site;. 
eer.  onst.ratior.  of  several  new  systems  that  could  understand  cor  e:  i -a.: 
spoken  sentences,  aver.  th.ougr.  the  results  were  far  from  perfect, 
tney  v;erc  extremely  enlighten j  r.g.  Ti.e  harpy  Sy  ster..  for  ex.u.  :  .  . 

far  exceeded  its  design  goals  oy  correctly  understate ir ..  9s. 
tr.e  sentences  sucker.  ay  hive  speakers.  It  usee  a  101  1-woru  vc  ctw- 
ulary,  and  a  highly-constrained  gran  mar  cf  sentences  relevant  tc 


a  task  concernin0  the  retrieval  of  documents  from  the  computer 


memory . 

In  1973,  IBM  developed  a  system  for  automatic  recognition  of 
continuous  speech  that  correctly  recognizee  9C%  of  the  7  cir.,it 
numbers,  with  a  per-digit  accuracy  rating  of  better  than  99‘A.  Ir. 
1976,  Texas  Instruments  developed  a  system  successful  ir.  verifying 
trie  speaker's  voice  before  permitting  access  to  trie  medium  itaeii. 
[Kef.  6] 

At  present,  there  is  a  great  desire  to  improve  the  quality  of 
continuous  speech  recognition  technology.  Due  primarily  to  its 
increased  speed,  naturalness  arid  mobility,  researchers  have 
recognized  its  importance  in  nary  varied  applications  (i.e.,  Air 
Traffic  Controller  training,  key  word  iceriti f ication  ir  monitored 
conversations,  command  and  control  environments,  cockpit  communi¬ 
cations.  etc.),  and  the  necessity  to  exploit  all  capabilities. 


D.  TYPES  OF  EQUIPMENT  USED 

The  f.'WISS  was  the  nucleus  of  this  experiment.  In  addition, 
the  VLRBbX  3000  and  the  Macintosh  microcomputer  were  cor  f  igured 
for  use  as  two  cf  the  experinental  input  mediums,  anc  the  peripheral 
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1  1  /  7  d  C  usee 


*e*y  board  attached  to  the  VT1C2  terminal  of  the  VAX 
the  third. 


ro.arcir ;  Continuous  Speecr.  Xeccc  r.itior.  Systems.  it  a  .. e a  ; 
for  use  in  industrial  ar.c  commercial  applications,  sj.u  :,or,w 
well  in  both.  hign  and  lev;  noise  environments  The  system  is 
capable  of  recognizing  natural  continuous  speech  of  infinite 
length,  and  an  output  buffer  of  2UC  characters  per  recognition 
set  is  its  only  limitation.  [Ref.  7]  With  a  maximum  of  four 
speecn  processing  boards,  the  VERBEX  3000  can  recognize  up  to  3ou 
different  words  spread  over  as  many  as  20  different  grammars.  A 
finite  limit  to  grammar  size,  based  on  the  total  number  of  words 
and  complexity  of  the  node  transition  network,  is  necessary  tc 
allow  tne  device  to  remain  "real-time"  in  terms  of  computation 
speed  and  men  ory  (i.e..  stored  voice  patterns)  requi  rer.  ents .  Thus, 
the  total  application  may  involve  up  to  360  words,  but  at  any 
instant  the  recognizer  is  dealing  with  only  one  grammar  subset. 
[Fef.  6]  The  VERB EX  3000  system  includes  the  Speech  Application 
Development  System  (SPADS).  This  system  allows  the  user  tc  run 
applications/software  other  than  those  procuced  by  VERBEX  3000. 
Nevertheless .  any  program  must  be  written  in  the  program:.  it.c 
language  Pascal  in  order  to  effectively  control  the  application. 
It  is  through  the  use  of  SPADS  that  Lombardo  (an  {(PS  gracuate 
student)  was  able  to  develop  a  prog  ran  in  which  voice  commands 
were  uceo  in  conduction  with  the  wargaming  scenarios  usee,  in  ti.e 


Eh  ESS.  [  ?:ef .  t  3  Additional  equipment  i'or  tne  VEKEKX  iOOu  it  c.u-i. 
a  smell  speecr.  unit  which  prompts  the  user  for  t:  t . t  v  or- 

phrase .  This  unit  will  echo  the  cornua  no  ii'  subsets  c:'  li  ruses  3  re 
res  sec  tc  complete  the  c  c: at  id .  The  subjects  ir,  t:-i  s  rXprn:  v-r.t 
uusc  a  Shurs  this.',  headset  ( clcse-spea^i  n.-. )  ..hmti  me  v  ....  '  . 
cecicated  input  device),  anu  the  Ciegler  m)!'.  31  ter;,  inti  tc  j 
th.e  VERTEX  300C  system  with  the  VAX  11/7&G.  This  particular 
terminal  echos  all  user  inputs  including  commands  aric  errors 
identifies  as  Control_K's. 

2.  l5bor.a_t.Q_rv  Ecu  lament 

This  experiment  required  three  input/cutput  terminals 
(VT-102  series),  three  status  board  terminals  (VT-1GG  series)  ana 
three  P.amteU  color  grapuic  display  terminals.  The  th.ree  ir.put/cutput 
terminals  were  assigned  as  control,  umpire  anc  master.  Eacn 
subject  (as  well  as  the  umpire)  hac  a  color  graphic  display  tc 
view  the  scenario  in  progress.  Status  beams  for  the  two  subjects 
proviaed  accurate  ccmfcat  information  for  the  respective  forces, 
and  the  umpire  had  access  to  all  information  on  a  special  status 
board  confi^ureG  for  that  purpose. 

E.  PREVIOUS  NAVAL  POSTGRADUATE  SCHOOL  STUDIES 

In  tne  past  several  years,  there  have  beer;  a  multitude  of 
experii.  er.ts  anc  tneses  developed  at  the  UPS  to  realise  tne  potential 
arm  11  nits  of  Speech  Eecogniton.  This  section  will  review  the 
findings  of  a  few  of  these  studies  as  an  attempt  to  summarise  the 


progress  to  date 


in  i  i  i  rezeai  ci.  occurred  wt.ic:;  anai>zee  speecr.  rt:ccw;:i  i:j;i 
as  a  means  tc  in.:. r eve  speed  and  reliability  ir.  the  tas..  oi  i;  a _ery 
interpretation.  The  purpose  ci  the  experiment  was  to  d  cw  an 
officer  to  devote  mere  tir.e  to  concer  trate  or:  the  object  c  :  r. . 


i  c r. 1 1  i  1 0  ^  z z)  - 


1 1  i  >  l*  o  x  r*. .  1 1 1  f  i  i  c  r ! .  t  i  j  i 


A  discrete  voice  system  (i.e.»  Thr  os  he  Id  >  TcCC  equipt.  t.-::t ) 
used  to  conduct  the  experiment,  and  the  analyst  feunu  that  t..o 
voice  system  was  approximately  503  faster  than  typed  oata  entry. 
As  far  as  "reporting  accuracy",  no  significant  differences  were 
noted.  [Ref.  9]  Concur  rently .  in  1961  a  i.PS  student  studiec  the 
practicality  of  using  voice  systems  in  a  war  game  environment. 
The  objective  here  was  to  play  the  game  scenario  utilising  a 
discrete  system  (T600)  and  a  standard  keyboard.  Performance 
measures  that  were  evaluated  included  time  required  for  each 
input,  and  the  number  of  input  errors.  The  game,  entitled  Warfare 
Environmental  Simulation  ( VIES ) .  (later  evolveu  into  h'U'ISS )  provicec 
the  interactive,  real-tine  wargame  used  in  this  experiment.  Ti.e- 
student's  experiment  suggested  that  the  keyboard  entry  was  faster 
ana  resulted  in  fewer  errors.  [Ref.  10]  Uhy  then  was  there  a 
difference  in  outcomes  between  these  first  two  studies?  Apparently, 
tr.e  i.iet hod  of  measuring  the  errors  was  different  ir  the  '..Eh 
experiment.  The  total  errors  for  the  voice  entry  induces  recog¬ 
nition  and  operator  errors,  while  the  keyboard  entry  totals  only 
includeo  the  typing  errors.  For  the  imagery  interpretation  exper¬ 
iment,  the  methoas  used  to  measure  errors  for  both  input  devices 
w as  identical. 


.  A,  •*.  C  •  ■  •  'Vs  ,v  .  ,v  ,  •  . 


beverai  ot..e  r  eri;  erts  usirj,  discrete  sy  ster.  s  wcr*.  cci.-jcuc 
Mi;;-  similar  results.  T:.e  "better"  method  oeper.Gta  or.  the  des  i 
H  C  2  ,  toe  experience  level  of  toe  subjects .  tr.e  extent  c : :  •• 
t r i  r  i _  or'  the  su ejects  .  etc. 

_  r.  1  v  i •  ,  d t  o  c. * . tr  r  .  i  .  c  r  l  cef  t.  ..  c  i  *  *  ^  ^  "j  .  l.  *  -■  _  -  ,  - 

to  evaluate  tr.e  use  of  continuous  voice  recognition  tec:  t.:...  . 
in  a  wargame  environment.  The  student  developed  toe  application 
software  tc  run  the  i  VIES  warwame  usiri.^  tr.e  V hr. BET  30CC/ccni.ir.uCuc 
speech  sy s ter;..  This  software  became  trie  foundation  for  t;  e 
r  i  jht/Manson  thesis;  the  final  thesis  before  this  experiment.. 
Tne  autr.ors  of  the  thesis.  Wright  a  no  ;  i  a  r.  s  c  n .  evaluated  toe 
effectiveness  of  three  input  devices  (continuous  speech,  c:  lucre  te 
speech  and  the  standard  keyboard)  while  running  the  HU  IBS  warp, si. .e. 
Tire  r.onirtuitive  conclusion  suggested  by  'Aright  and  Hansen  was 
tnat  trie  keyboard  players  aid  better  overall.  Furtr.er  researc. 
gave  sc  rue  possible  plausibility  for  tiis  result.  During  low  ii^tt 
sessions  almost  all  the  /eybeard  subjects  i.iovec  the  keyuoara 
panel  closer  to  the  CM  to  alleviate  a  perceived  handicap.  A  post 
experiment  survey  also  revealed  that  the  keyboard  group  has.  t.ie 
richest  typing  SKill  level  of  the  three  groups.  Additionally, 
tiie  discrete  system  fared  v;ell  below  the  other  methods  in  the 
majority  of  trie  comparisons,  ano  ever,  though  snorter  train:  r._  was 
rep  ui  red,  incorrect  recognition  was  more  likely  to  occur  truer 
varying  levels  of  ambient  noise  ano  dissimilar  user  voice  patterns. 

From  the  results  obtained  in  the  h'right/Mar.son  thesis  it  car. 


be  ascertained  that  wriie  the  keyboard  still  remains  an  alternative 


for 

computer  ir' 

t  e  r  f  a  c  e  , 

the  discrete  sys 

ten  (however  effective  i: 

r.ay 

be)  is  not 

natural 

t  c  a n  imciviuua 

i’s  way  cf  spoahii;,.  ;i:c. 

does 

not  merit 

furt  r.er 

investigation. 

Concurrently,  it.  is 

recognized  that  ore  evaluation  c:'  the  ccr.tini.ous  spcec.-.  recc..  r  i 
eye  ter.  i: s  n  ceded,  ar.ci  it  snail  oe  ciscusscu  fur  tier  i:  ..ter 
chapters  of  this  thesis. 

F.  PROBLEMS  OF  SPEECH  RECOGNITION 

with  any  field  of  study  there  are  many  problems  whic.r  r.t-rc;  to 
hinder  the  progress  of  new  technology;  ar.a  Continuous  Speecn 
Technology  is  no  different  ir.  this  regard.  Nevertheless,  several 
additional  factors  must  be  considered  when  human  tenavioT  is 
involved.  For  instance:  Can  an  inexperienced  user  operate  a  voice 
system?  ’./ill  the  system  accurately  recognize  an  individual's 
voice  signals?  In  general,  ti.e  bigger  the  system’s  vocabulary 
capacity,  the  more  prior  training  will  be  required.  Also,  if  a 
large  number  of  sentences  and  alternative  phrases  need  to  be 
recognized,  additional  training  may  be  necessary.  The  vocabulary 
itself  plays  an  important  role  in  Determining  the  systems  ability 
to  recognize  utterances  with  any  degree  of  consistent  accuracy. 
In  other  words,  it  is  much  easier  to  recognize  ICO  distinct 
words,  than  to  recognize  100  "rhyming"  words/ phrases  (i.e.,  a 
"light  house"  vs.  a  "lighthouse"). 

Another  difficulty  occurs  when  there  are  "highly  constrained" 
sequences  of  words  (i.e.,  stock  numbers,  telephone  numbers,  etc.) 
or  carefully  formatted  phrases  (i.e.,  air  traffic  control  cor., mar, as, 
fixed-length  commands  with  each  word  selected  from  a  predetermined 
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vocaouiarj  .  etc.).  lr.ese  wares  or  prirases  require  a  r  ere  cor..;, i etc 
analysis  ",c  insure  the  proper  context  of  each  wore.  It  is  also 
extremely  important  that  the  speaker  articuiate/anrunci  < te  eacr 
v.'crd  in  the  comma no  . 

One  of  the  oiliest  difficulties  errccur.terec  when  oe-ai  ir. 
s p e e c r  recognition  is  the  unwanted!  ability  of  the  n  icropr.ct;«  tc 
pick  up  outside  noise,  or  sounds  from  the  environment.  While  it 
is  a  fact  that  real  life  conditions  may  encounter  additional 
noises  causing,  degradation  in  the  systems  ability  to  accurately 
recognize  vjords.  the  judicious  use  of  available  testing,  facilities 
will  allow  cptimun  conditions  on  a  regular  basis.  Another  possible 
solution  is  to  use  "close-talking”  microphones  or  headsets. 
These  particular  devices  are  able  to  differentiate  between  nearby 
sounds  and  sounds  heard  at  a  aistar.ee.  [Ref.  6] 

Cost  is  another  very  common  problem  with  this  technology.  For 
Research  and  Development  companies  and  comr.  ercial  users.  toe 
initial  cost  is  very  high.  At  this  point  in  time,  the  oemcrci  for 
continuous  speech  recognizers  is  not  enough  to  stimulate  the 
significant  number  of  grants  and  contracts  necessary  for  adequate 
research. 

The  question  that  is  uppermost  ir.  the  mirds  of  many  con. ercial 
investors  is  not  whether  the  equipment  is  affordable,  out  is 
it  necessary?  Do  we  really  r.etc  a  continuous  speech  recognizer? 
Some  people  argue  that  "isolated  wore  recogrizers"  are  aaequate 
for  most  jobs.  The  fact  still  retains  tr.ere  is  little  doubt  that 


if  improvea,  the  sheer  mobility  and  flexibility  of  continuous 


A.  INTRODUCTION 


Air.;:ou,.n  ti  e  cube  against  its  fruitier:  see  wr !...  ;  • 

1  :70.  t;  e  :  acir.tcsr  ~  i  c  recompute:  r .  oc-s  ignew  s;,  a  3.1  r:_:  .  . 

i  nex  p  tr  i  o  r  ced  or., it  e-;rs  arc  prograrr  ers.  is  r.ow  rccc.,t::z-:  v.vr,  :  - . 

sc  a  technological  marvel  in  personal  computers .  in*,  heavily 

or:  symbols  ana  asscciatec  pictures  on  the  screen,  it  is  uesirr.ee 
prirarily  tc  help  people  conquer  computer  phobia  and  ce  as  easy 
to  use  as  a  television,  set.  It  is  this  ease  of  use  attribute  tost 
made  it  so  attractive  as  a  possible  testbed  interface  device  for 
warrame  simulation.  [Ref.  11] 

Tr.is  chapter  will  focus  on  some  of  the  terminology  irnerent 
in  n  icrocomputers  *  describee  the  origin/ back-yrounci  surroundin':. 
Mac  i  r.tcsh  ’  s  innovative  technology  and  its  adaptability  to  experi¬ 
mental  design,  and  lastly,  describe  the  equipment  that  was  uses 
in  tie  experiment. 

B.  BACKGROUND 

The  Apple  Corporation’s  Macintosh  microcomputer  is  bui;t  on 
tiree  (3)  primary  ideas: 

1)  second-generation  Lisa  technology  (an  expensive  desktop 
computer  designed  for  commercial  use  that  pior.eerec  the 
merging  of  graphics  and  "mouse "-oriented  peripheral 
operation )  , 

2)  reliability  and  low  cost  through  ir.breo  simplicity, 
and 

3)  a  maximumization  of  the  synergism  possible  between  hardware 
and  software. 


2  A 


Pcuerec  by  the  deuicated  21  .bit  ion  cf  Burrell  omits  ( :•  ;  nr:,  cr 
Ap  pi  e  Computer  Cor  pc  ration  ::  aintenance  tecr  nician  )  Jn-vcr,  Jo;.: 
( trie  chair::  an  cf  Apple,  and  toe  .'aci  r.tosh  project  ci rector)  or... 
or.  elite  project  tear,  o:  "visicrary  reaicais"  ♦  At;-  le  has  t  us  cc  v_\. .. 
in  erecting  t  mac  mi  ne  trot  weighs  only  20  pauses.  cor:  0-  c r  r . 
in  a  tete  bag  and  has  :.  any  of  the  significant  features  ir. trocuceu 
in  January  cf  1963  with  the-  Lisa  computer.  Alth.ou-.u  it  uses  a 
"rr.ouse"  (a  pointing,  device  roughly  the  size  of  a  pock  cf  cigarettes) 
that  permits  users  to  give  commands  to  the  computer  via  a rm/ r.ar.d 
movements  ana  button  pushing,  there  are  four  ( 4 )  basic  cifferences 
frorri  the  Lisa  that  make  it  second-generaticr,  oriented: 


1)  a  much  higher  deck  speec  (7.63  LHZ  vs.  the  Lisa's  5.C 
MHZ  )  . 


2)  smaller  memory  usea  tore  efficiently  through  the  LCbuGuO 


processor. 

3)  an  elimination  of  adc-cr.  peripheral  cares  through  tre 
extended  use  of  a  nigh  speed  serial  bus  couples  with  tre 
implementation  of  "virtual  slots",  and 

4)  it  allows  only  one  applications  program  to  be  active-  at  a 
time  (an  important  limitation). 

Although  this  latter  limitation  aspect  sects  serious  it: 
nature,  it  actually  facilitates  the  use  of  multiple  window  operations 
anc  allows  material  to  be  "cut  and  pasted"  from  ore  document  to 
another  by  a  "clipboarc"  arrangement,  nevertheless,  the  atser.ee 
of  hardware  slots  artci  tre  lack  of  ability  to  run  two  simultaneous 
appl ications  are  the  two  important  separation  criteria  from  that 


of  the  Lisa 


technology.  U-ef.  12] 


Ly  coc.cinin*,  tnc*  functions  ci‘  mary  standard  chips  int<.  ei.ut 
pro;  rai  r.  able  1  o  £  i  c  arrays,  it  rakes  it  possible  for  tne  hacintcs:: 
to  keep  its  cr;ip  count  ( a  no  therefore  its  price)  relatively  _  r  w  , 
vi  r  j  1  e  si  mui  taneousl  y  producing  a  serine  tr.st  was  a  rei  ia-i  -  .  t  • 
factor  character  i  sticaiiy  associates  witt.  nruen  S; pier  com.  ate  rs  . 
hi  tn  only  two  printed  circuit  bcarcs.  it  was  cleverly  uesi.„r,c-  to 
eliminate  the  need  for  harawsre  fire-tuning  during  asset,  oiv  or 
use.  It  is  tnis  combination  of  reliability  anc  simplicity  or. at 
rakes  it  an  ideal  training  or  input  interface. 

The  Macintosh's  hardware  and  software  are  fully  optimizes  for 
maximum  potential.  This  simply  means  that  trie  careware  art.  software 
have  evolved  slowly  ever  a  period  of  time  t h a t  has  preview  a 
mutual  "give  and  take"  association.  As  a  result,  trie  video  display 
hardware  design  greatly  simplifies  the  software  design;  ai  icwj  r: 
it  to  easily  draw  squares  arc:  circles,  scale  text  ant  graphics 
and  print  screen  images,  utilizing  this  feature  to  its  fullest. 
Tom  Cor.canron  (a  P S  graduate  stuuent)  was  able  to  develop  the 
fi  W I S  S  war  game  i  r.  ter  face  program  in  tiie  BAflC  language  to  allow 
the  experiment  subjects  to  play  the  various  war game  scenarios. 
This  program  activated  the  "user  toolbox",  which  is  primarily 
responsible  for  manipulating  all  the  various  relative  relationships 
between  different  units/accessories  in  the  MCdcOOO  processor .  ~y 
stimulating  the  window  and  menu  managers,  the  subjects  were  tt.en 
able  to  use  the  mechanical  mouse  to  select  wargame  con. r.  arcs  from 
a  two-dimensional  matrix  of  menu  items.  The  selected  input  was 
coordinated  through  a  resource  manager  facility  which  perpetuated 
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t : .  e  eventual  interface  necessary  for  co;,i..uric5tlcn  anu  cc.:.:  .arc 
actuation  or:  the  VaX  1 1/7GC  computer.  An  example  of  etch  menu 
color  n  followed  by  all  the  possible  user  selections  is  cents  i :  c- ; 
i  r.  the-  i  ictorial  section  of  the  Mac  i  r  tosh  I- :  c recompute r  ts-^r's 
Au:.:e  (see  Appendix  G).  [lief.  31 

C.  EXPERIMENT  HARDWARE  DESCRIPTION 

The  Macintosh  has  received  numerous  accolades  for  its  impressive 
sesi^n.  It  is  truly  a  highly  developed  microcomputer  that  effectively 
uses  a  mechanical  mouse  peripheral  and  a  32  bit  microprocessor  ir. 
a  lightweight  portable  package.  It  is  its  portability,  functions] 
simplicity  and  ease  of  use  that  make  it  the  ideal  selection  for  a 
user  interface  device. 

The  Macintosh  microcomputer  is  a  self-contained  unit.  (9.7b  by 
9.75  by  13.5  inches)  consisting  of  a  main  unit,  keyboard  arm 
mechanical  mouse.  It  uses  standard  AC  external  power,  has  tv;c 
serial  ports  and  an  integral  Sony  3.5  inch  disk  drive  which  holes 
up  to  400  Kbytes  of  information.  Its  standard  128  Kbytes  of  RAM, 
anc  64  Kbytes  of  ROM  were  reconfigured  oefere  the  actual  experiment 
to  512  Kbytes  to  accomodate  the  slight  command  entry  delay  experi¬ 
ences  by  users  at  the  lower  configuration  setting.  The  nine  (95 
ir.ch  monochrome  monitor  provided  an  adequate  display  of  rIJ 
pictorials,  and  its  58  key  detachable  keyboard  serveo  as  a  comfor¬ 
table  medium  for  a  bacKup  typing  input  mode.  The  main  source  of 
user  input  was  a  small  mechanical  mouse  which  is  physically  moveu 
in  a  rectangular  series  of  hand  movements  to  position  an  onscreen 
arrow  to  the  desired  menu.  Keeping  the  index  finger  positioned  or 


a  conveniently  mounted  cotton,  the  user  manipulated  t;;e  oust  tc 
position  the  trrcw,  and  used  the  button  to  extern  t:.e  -t si  re-, 
menu  ana  select  the  appropriate  ccitr  ar.d  for  subsequent  i . e .  -- :  - 
tcition.  A  detailed  oescript icn  of  toe  r..echarics  involves  :r  a 
operation  is  Spain  available  cy  referencing  Appendix  i.  [ '.  ; 

ana  2  ] 

RAMTSK  high  resolution  eoler  graphics  monitors  were  us to  u 
display  the  game  scenarios  to  the  subjects  at  their  respective 
positions,  and  the  digital  VT1C0  terminal  was  used  as  a  static 
board  for  each  NV1ISS  session.  The  configuration  of  the  laboratory 
itself  will  be  further  described  in  Chapter  VI,  arc  a  pictorial 
display  of  the  physical  layout  provided  (see  Figure  6.1). 

A  conventional  cassette  tape  recorder  was  used  to  play  g 
pre-recorded  background  noise  tape  curing  each  i'UISS  session.  One 
eight  inch,  eight  ohm  speaker  was  placed  at  a  pre-establish.ee 
distance  from  each  subject,  and  an  audiometer  was  used  tc  verify 
the  decibel  settings  for  each  light/noise  environment  specified. 
The  pre-recorded  noise  consisted  of  a  gathering  of  approximately 
thirty  (30)  people  speaking  in  a  conversational  tone  within  at; 
auditorium.  [Ref.  2] 

D.  SUMMARY 

This  chapter  has  served  to  discuss  some  of  the  terminology 
inherent  ir.  the  des  i  0n/desc  r  i  p  tion  of  the  Macintosh,  microcomputer, 
and  has  presented  some  of  the  background  theory  arid  history 
behind  its  origin.  Although  there  were  no  previous  wargame  scenario 
experiments  conducted  at  the  ?JPf  involving  the  use  of  the  Mac  ir  tosh, 
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IV .  THE  NAVAL  WARFARE  INTERACTIVE  SIMULATION  SYSTEM  (NWISS) 

A.  INTRODUCTION 

T i  5  c:  ...  ter  coi  u  r :  *?  f  cescri  pticn  o:  :  ..  If.  m  ;  •  .. 

j  u :  ;  c  f  •  t  fol*.  in.  a :  :  3  expert:.  or:*.  .-11  :ce:;:Tico  i.cvo.cLt  ..  :.r  •. 

or.  f  crv,  «!’.*.  »  the-  measures  of  effect!  veiuroo  st.ecffcc  a:;,'.  t:.”  v.t.._  „  s 

usee  tc  collect  data  ana  compare  the  two  cor.n  ana  input  technolo  ir-s 
ore  also  described. 

B.  WHY  NWISS  WAS  SELECTED 

NWISS  is  a  real-time,  user-interactive  simulation  of  ravsi 
warfare.  Its  rission  was  ori0ir;ally  to  train  senior  Laval  u:  f :  cere 
it  force-level  tactical  decision  making  ar.o  ma  nap, erne  r.t.  cf  co:.  ;.,ar:c. 
and  control.  At  the  Naval  Postgraduate  School.  LuISS  resides  on 
a  VAX  11/760  computer,  and  the  peripheral  VT1CG/1Q2  terminals  aru 
F.AJ  Trl'.C  graphics  terminals  provide  the  necessary  input/output 
modules  when  grouped  together.  Voice  equipment  (i.e.,  the  V ERL LX 
300C )  ,  arc  "crop-dour."  window  microcomputer  technology  (i.e..  t:  e 
’  ccintosh  microcomputer)  were  used  as  interface  devices  i:  t.i.e 
available  modules .  ana  all  it. puts  and  outputs  were  acc01.4lisr.ec 
oy  traired  subjects.  NWISS  was  loadec,  control] ed  a no  moritcrec 
from  a  third  "command"  module  ourin^  these  experiments.  Tie 
purpose  of  .Cfl.XC  i  r  this  experiment  was  to  stimulate  a  stressful 
environment  tout,  would  allow  user  intervention  via  LI.  I. 1C  command  s . 
From  the  user's  poirt-cf-view,  it  has  a  la  rt,  e  vocabulary  cf 
c  errands  to  cnan6e  the  view  of  the  tactical  situation  1  r.  too 
tattle  arena,  cause  changes  in  tne  course  anc  speed  of  vehicles 
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KWISC  wss  useo  tc  support  this  experiment  because  it-: 

1 .  Offeree  the  ability  to  present  identical  tactical  situations 
to  two  isolated  subjects  sir  ultarieousiy  .  This  control  j  eu 
environment  allowed  a  side-by-side  comparison  of  the  cot. anu 
input  methods  cnosen  by  trie  isolated  subjects  when  confronted 
by  identical  tactical  stimuli.  Additionally,  the  system 
was  readily  available  at  the  UPS  •  and  a  pool  of  trainee 
operators  were  accessible  for  "on-line"  consultation. 

2.  Provides  a  large  system  vocabulary.  Consensus  of  opinion 
was  that  if  a  small  vocabulary  was  chosen  to  run  the 
experiment,  the  subjects  may  become  bored  through  sneer 
command  repetition.  Approximately  150  words/utterances  were 
deemed  necessary  to  properly  cor.auct  the  variety  cf 
inherent  missions  within  the  capabilities  of  an  Aircraft 
Carrier  Battle  Group.  Twenty  commands  relating  directly 
to  the  control  of  the  tactical  force  display  were  also 
included.  Tables  of  trie  complete  vocabularies  for  the 
two  input  technologies  are  includea  in  Appendices  F  a  G. 
These  vocabularies  were  predetermi r ed  art  were  limited  by 
the  site  of  the  memory  of  the  VEFiElEX  3000  system.  Us:n  . 
trie  forces  art  commands  in  these  subsets  of  the  i.hli.G 
dictionary,  four  previously  aeveloped  scenarios  were  usea 
as  a  mi  e  hi  urn  for  stimulating  subject  irterest,  aim  for 
generating  a  mearingful  NCE.  [Ref.  14] 

In  all  four  scenarios,  the  Crarge  anc  Neutral  force  actions, 
defensive  posture  and  radar  emissions  cortrol  (EMCOil)  status  were 
preprogrammed.  Grange  aircraft  were  eliminatec  from  this  e-x  peril;  er,  t. , 
to  avoid  unnecessary  system  program  complexity.  The  two  available 
views  of  the  world  for  the  Blue  fcrce-s  were  simulated  cn  approxi¬ 
mately  the  same  latitude,  but  were  physically  separated  in  longitude 
by  500  nautical  miles  at  mid-ocean. 
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L  1 i t c tv  a  r  ax  i  r  urn  c f  six  secs  of  ;orcec.  am 
•; r  c r ;  e  ;.r. :  eutral  forces  were  eocr  sr. rccturec  appropriate! 
r  f  i  <=>  c  t  cr.v  v  1  .  Tr.e  s  pec  i  i  i  c  process  for  ssoeti:!;  r  •  • 

various  vi.wc  overlapping  t;  er  is-  exriair.es  :  r.  so::  e  -ctr 

c  .  revious  iff  t.  esis  c-y  C  ::  arc  brown .  fief.  If]  -aoic 
a  were  w ere  two  separate  views  for  tre  flue  forces  vr.ic..  s. 
tf e  subjects  to  irciivicually  control  their  own  ships  a r: o  pi? 

C.  SCENARIOS 

Four  unique  scenarios  were  used  in  order  to  effectively 
subjects  in  situations  requiring  the  use  of  trie  available 
vocabulary,  and  to  stimulate  inciividual/di  fferent  responses, 
section  cescribes  tr.e  basic  opening  force  positions  for  ea< 
the  scenarios  and  the  accompany i rib  military  situation  sri 
for  that  scenario.  The  actual  situation  briefings  giver  t< 
suojects  are  ir.cluuea  ir.  Appendix  A. 

•  •  S^n^riS..  A 

One  aircraft  carrier,  twelve  P3C  aircraft,  two  fri,_ 
and  an  attack  subr.  arine  are  assigned  to  the  blue  forces,  G 
forces  include  one  aircraft  carrier  ar.c  six  surface  combat 
and  are  escorting  eight  neutral  merchant  ships  in  a  convoy 
is  moving  south  as  shown  iri  Figure  4.1.  The  merchant  cl::;; 
reportedly  carrying  nuclear  arid  chemical  weapons  t.c  ar.  uniuent 
Grange  ally.  Hostilities  have  beer,  declared  between  trie 
and  the  Orange  forces  arid  the  objective  is  to  identify  end  ue 
the  Grange  escort  vessels  without  ir.vol  vi  ng/destroy  ir:  g  tr.e  me  r 
ships. 
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c  e  n  a  r  i  o 


Blue  l'crces  consist  cf  two  P3C  aircraft  ic  provide  tre 
necessary  targeting  irfor:  at  ion.  one  ai  rcraft  carrier  an-  v.-..c 
flights  g:'  live  attack  aircraft.  Four  Crsr,,_e  surface  cg:;;  :ioi  us 
arc  .csiticr  oi  between  r. :  esc  Flue  forces,  arc  twenty  --ro.  a 
vessels  are  at  oner  or  cuts  ice  a  fictitious  harbor  facility  waitirw 
to  unload  their  car^o.  Hostilities  t.ave  rot  been  declares  ctucer, 
Blue  and  Grange  forces,  although  tensions  remain  high.  Tr.e  i_..e 
force's  mission  is  to  use  the  assigned  airborne  aircraft,  anu  tie 
remaining  aircraft  carrier  based  assets  to  conduct  a  strike  on 
the  merchant  vessels.  Rules  of  engagement  do  not  permit  fir;,  t;  sy 
the  Clue  forces  until  the  Orange  forces  have  fired  on  them.  Fro: 
trie  opening,  positions  as  shown  in  Figure  A.  2.  neither  tre  mere:  ant 
ships  nor  the  Orange  combatants  are  visible  to  the  Blue  forces, 
out  a  northerly  course  is  dictated  by  the  mission. 

3  -  Scenario  C 

A  favorable  environment  is  present  in  which  Blue  taskir^ 
is  to  locate  and  identify  as  n  any  objects  as  possible  anu  ceni;ir;str 
them  as  Friendly,  Neutral  cr  Enemy.  Blue  forces  have  one  rod  ant. 
four  F 1  a  a  aircraft  to  accomplish  this  mission,  and  Combatants 
for  both  Blue  ana  Orange  forces,  as  well  as  several  merchant 
ships  and  fishing  vessels,  are  all  in  a  U00  X  500  nautical  mile 
rectangle  (as  depicted  in  Fig.  A. 3).  ho  control  of  tre  Blue 
surface  forces  was  permitted  to  complicate  the  tasks  of  location 
and  identification. 
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re  p  1 1 1  c  c  a ; .  rat.st  esc.-  czi.er.  .iue  i  o  r  c  c  o  a  r  e  s t-c  .  *  u  - 
u  s  e  a  to  locate  anu  i  o  e  r  tiij  tne  dei.  f  :,i»  c  I  t :  e  -  i  .  r  c 

.  1 1 1  -v  .  r:j;  .  hostilities  r.sve  nor  h  <•:  r.  ^oedreu.  of.  :.  •. 
or-  siioveu  wiie  latitude  in  their  n.-rrense  to  any  i.r  n  :  r: 
qrressive  action.  The  opening  positions  in  Figure  4 .  •’*  pi  tee  t. 


ran,.e  force  carrier  tattle  ,roup  to  the  North  cf  the  d : 


.  e  i  c.  i '  c:  v 


roup;  witti  the  C  r  a  n  r„  e  force  hescea  North  one  trie  rlue  force 
trtcea  to  the  Northwest. 

.  MEASURES  OF  EFFECTIVENESS 

All  subjects  were  far.  il  iar  with  tne  NVJISS  wart.,ar:  i  r scenarios, 
ore  of  the  cor.manas  ( i.e.  .  ch.atfin0  tie  scale  of  the  display  ) 
ere  easy  to  accomplish  and  rapicly  assir.ii  latec .  while  ct;  era 
suer  as  tne  launch  sequence)  required  patience  a.nc  ccnsicerade 
ractice  to  implement  correctly.  When  trie  subjects  receives  tieir 
issior  briefing  oefore  each  session,  they  were  told  acre  of  tne 
ensures  of  e f i ecti veness  by  which  their  success  or  fa il ure  wcuaC 
e  determined.  Induced  were  suer  tilings  as  tiic-  number  of  i..erci  ant 
osseis  sunk  or  damaged  ir.  Scenario  S.  the  nunoer  of  ships  correctly 
ocatec  a  n  o  identified  in  Scenario  C ,  and  the  number  o  i  due 
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Figure  4.1  Scenario  A 
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Figure  4.3  Scenario  C 
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t. r. e r  ccrres t o n a :  n . 


commands  entsre-  ws;  considered  to  L 


.  r  - c  i s  v  investor  or 


;«ry  over  t.-  e  1 . . 


:  v. u r  oc^r. 


noise  ieveis.  irovic.ee  tr.e  osoortur.it 


lUoject  to  use  couniancs  available  ur.ter  varying  er.viro 


conditions.  Heal-wcrlu  tir..e  constraints  anc  accompany!  nj  pr* 


were  impressed  on  tr.e  subjects  by  tiie  scnedule.  anu  by  ti 


i  t-r  u  C  i.  v  •  ■ 


erste .  overt  actions  of  the  facilitators.  Since  all  the  sessions 
lasted  trse  same  number  cf  .-•are  r.  ir.utes »  trie  number  of  cos.;.. anus 
entereu  was  essentially  a  rate  of  entry.  The  astute  subject  coni  a 
save  increased  this  rate  significantly  simply  oy  repeated 


very  in 


ii splay  radius.  by  stressing  the  fictitiously  „fcr.ervtv. 


;  Gfs,  tula  type  cf  performance  was  indirectly  uiscoura.,cu . 

It  '..as  determined  through  supervisor  consultation  anu  ...roup 
advisory  discussion  that  accuracy  can  be  measured  to  sc;  extent 
by  tr.e  number  of  tines  the  "Controi_h"  com;.. anc  is  usee  to  uoitt-. 
or.  attempted  command.  hevcrti.eiess .  tuere  are  some  limitations 
to  us  in ;  "Coritrol_M"  as  a  measure  of  tre  nut.be  r  of  errors  ..sue  wy 
subjects.  Circe  it  aborts  the  current  comma  no  and  does  not  sXr.ci.tc 


it.  tr.e  "Control  II "  could  be  viewed 


change  of  :.  i  no  or;  t.  e 


susject's  part.  rrorr  prior  experience  with  the 
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as  easy  t  c  enter  a  ccr..|  1  e  t  e  c  comma  no  ana  i  s  s  u  e  a  sue  sequent 
correction .  as  it  is  to  abort  the  command  completely,  [ief.  2J 
T.-.ere  are  also  two  equipment  related  factors  tnit  cotract  fro;. 


the  use  of  "Ccr.troi_k"  as  or,  error  counter.  First,  in  tie 
3CJ00  speech  recognition  system*  alter  the  key  bears  ras  Deer,  uses 
to  enter  an  I:\ii  command  not  included  in  the  15b  wort  vcc.t  salary, 
tr.e  "Ccrtrci_h"  comma  no  is  necessary  to  return  sc  the  ten  inr.ir... 
o:"  the  ccmr  ana  input  sequer.ee.  Therefore.  t.;is  use  of  "7 cr.sr.  _ 
does  not  indicate  an  error,  cut  tr.e  correct  use  oi  tr.e  ^yst 
Secondly  •  it  could  be  that  the  subject's  uttera  nce/wcrc:  was  not 
recognizea  by  the  system  and  the  subject  elected  to  enter  ti.e 
command  manually.  The  result  is  the  san.e  as  in  the  first  case: 
the  abort  command  must  be  used  to  return  to  the  start  of  a  new 
command  input  sequence.  In  a  deliberate  attempt  to  alleviate  this 
particular  "discrepancy",  the  authors'  evaluated  the  printout  of 
the  sessions  immediately  following  their  execution  so  that  mei.  cry 
of  the  subject's  rationale  behind  the  selection  of  a  Centre l_i. 
input  could  be  interjected,  and  subsequently  discarded  if  it:,  was 
not  intended  as  an  error  correction.  Overall,  despite  these 
considerations,  it  was  felt  that  the  "Contrcl_K"  command  provided 
the  best  measure  available  of  errors  made  in  entering,  commands; 
although  it  still  may  r.ot  be  as  strong  a  measure  as  the  number  of 
commands  entered. 

E.  DATA  COLLECTION 

Data  collection  was  a  c  c  o  m  p<  1 1 h  e  u  through  several  utility 
programs  of  the  VAX  1  1  /780.  All  commands  entered  by  trie  two 
subject's  command  terminals  were  sent  to  separate  files  in  metorj. 
as  was  the  record  of  the  umpire's  game  control  terminal.  This 
process  proviaec  a  reccrc  of  all  subject  activity,  a no  kept  a 


f.isnoricui  account  ci  a.*  encasements .  weapon  :  :r:rus  ana  resuiter 
-s:.:3:.;e  displayed  on  the  ur.  pi  re’s  terrinsi  for  x'urtlr  er  study.  ?• 
output  wap  toer  nsi.c-ccur  ted  to  cetern.ine  the  number  cl'  co arc 
entered  ar.u  toe  r.u.:.ser  of  errors  cor  iritteo. 

«t>;  Sviuiticnal  comment  is  warrantea  re.jsrain:..  l.ov,  toe  n.o.  te 
of  ccr.ti  anus  entered  vas  actually  deterfir.ee.  Toe  a  arc  raft  I  sure 
seduer.ce  is  widely  usee,  ano  is  the  most  lengthy  and  Lifficui 
cor.  r.  ana.  Si  rice  the  aircraft  launch  sequence  involves  at  leas 
five  lines  to  be  complete,  and  could  potentially  be  atone 
anywhere  within  those  lines,  each  line  of  the  five  that  wa 
correctly  entered  was  counted  as  a  command  entered. 


A.  INTRODUCTION 


Ceveroi  i  r  ucitaieni  :'oc:cr:;  were  considered  crucial  t-v  t..e 
success  cf  x.:  iz  experiment..  First  was  the  ccr.tir.ueo  o;.:e 
status  ci  t  r'c  criLiCa*  **  n  £  r  o  v.'  c,  r  t ,f  (  i  .  e «  ,  1 i  -  e  "i  i .  .'.  computer,  t .  - 

hwISS  warc.ci.ie  .  the  VERS EX  3000  system  and  the  Macintosh  computer )  . 
Secondly,  a  total  of  24  subjects  were  needed  to  participate-  in 
the  experiment.  Decisions  such  as  the  length  of  each  session,  tre- 
randonness  of  the  sequences  and  the  combinations  of  scenarios  arc 
environments  were  also  of  major  importance.  This  chapter  will 
oescribe  the  actual  training  and  practice  sessions  usirg  trie 
V  E  HD  E  X  3  0  0  G  /  K  a  c  i  n  t  o  s  h  n  i  c  r  o  c  o  n.  p  u  t  e  r  technology,  c  i  s  c  u  s  s  the 
background  of  tne  subjects,  and  elaborate  on  the  details  su r round  l  rM 
the  design  of  the  experiment. 

B.  BACKGROUND  OF  SUBJECTS 

The  2 4  subjects  who  participated  in  the  experiment  r.ac  a 
rryriac  of  backgrounds.  Twenty-three  of  them  were  arr.ee  forces 
officers  (i.e..  U.S.  Navy.  U.S.  fir my.  U.S.  Air  Force,  etc.),  and 
all  were  studying  Cot. m and.  Cor.trol  ana  Cornmunications  (C3)  at  tre 
Naval  Postgraduate  School  (DPS),  nineteen  were  male  arc  four  were 
female.  The  twenty- fourth  subject  was  a  male  civilian  computer 
operator  employee  at  I.'PS. 

All  the  students  participated  in  the  experiment  lr  conjunction 
with  OS  4602,  a  required  Operations  Research  course  titles  Ccimar.c, 
Control  and  Communications  Systems  Evaluation.  A  previous  Operations 


Research  course,  OS  3603  (Simulation  and  '.var  earning)  ,  introducec; 
the  students  to  trie  MV.ISS  background  and  syrbcloay  usee  for  tie 
experiment,  and  a  similar  course,  OS  3404  (Man-Machine  Interaction)  , 

ir. trooucec  them  to  Discrete  Automatic  Voice  Fecccniticn  Thee  it  . 
All  the  subjects  were  familiar  with  the  basic  facilities;  that 

is,  the  digital  VT100/102  keyboard  terminals  and  the  P.artek 
graphics  monitors.  Mone  of  the  subjects  had  ever  used  a  continuous 
automatic  speech  recognition  system,  and  some  had  never  usee  the 
particular  headset-type  microphone  incorporated  by  the  VERB UR 
3000  unit.  Additionally,  out  of  all  the  Macintosh  players,  only 
five  had  ever  used  a  mouse,  and  due  to  the  specific  nature  of  the 
software  program,  it  woulc  be  the  first  time  anyone  had  played  the 
WKISS  game  using  that  device.  The  civilian  programmer  was  to  be  a 
VERBEX  3000  player,  and  although  he  was  familiar  with  the  NWISS 
game,  he  had  never  played  it  using  the  continuous  voice  interface. 

The  24  subjects  were  divided  into  two  equal  teams  of  12 
people.  Each  team  would  only  use  one  input  device  (either  the 
VERBEX  3000  or  the  Macintosh) .  Selection  was  mace  randomly,  ana 
on  that  basis  a  VERBEX  3000  player  anc  a  Macintosh  player  were 
partnered  so  they  could  be  scheduled  for  each  session  simultane¬ 
ously.  Similar  classroom  schedules  we re  the  only  matchinq  prereq¬ 
uisite,  anu  although  the  amount  of  exposure  to  the  MKISS  was 
equal  for  all  subjects,  a  similar  statement  could  not  be  made 
concerning  each  individuals  competence  with  the  same. 


c.  ENVIRONMENTAL  CONDITIONS 

The  experiment  was  constructed  to  simulate  a  military  con  anu 
cine  control  center.  To  accurately  represent  this,  rour  oifferent 
environmental  conditions  were  uses.  One  of  four  comminutions  c : 
noise  ana  light  levels  was  establishec  for  each  run  of  the  exper¬ 
iment,  and  one  of  four  different  scenarios  was  used  to  ailev/  each 
player  to  experience  a  different  set  of  circumstances  anc  environ¬ 
mental  conditions  for  each  individual's  wargaming  sessions. 
Additionally,  by  alternating  scenarios  it  helped  to  precluoe 
familiarity,  and  any  possible  unfair  advantage  achieved  through 
intimate  knowledge  of  one  scenario  in  particular. 

Noise  and  light  conditions  used  for  the  experiment  are  summarily 
described  as  follows:  low  noise  (65  db)  ,  high  noise  (85  ob)  , 
normal  lighting  (approximately  1  foot-lambert)  and  lev/  lighting 
(lights  completely  out;  approximately  .05  foot-lambert).  The 
introduced  noise  was  measured  in  decibels  with  an  audiometer 
(on  the  C-scale) ,  and  readings  were  taken  at  the  subject's  "ear- 
level"  with  the  stereo  speaker  approximately  2-3  feet  away. 
Light  conditions  were  measured  with  a  light  meter.  Normal  light 
conditions  of  1  foot-lambert  were  achieved  by  maintaining  the 
overhead  track  lights  on  and  directed  at  a  45  degree  angle  toward 
the  nearest  wall.  With  the  lights  out  in  the  lev/  lighting  setting 
the  only  lighting  available  to  the  subject  was  the  light  emitted 
from  the  associated  CRT  and  Ram.tek  graphics  screen. 

To  the  greatest  extent  practicable,  physical  partitions  v/ere 
usee  to  maintain  the  appropriate  noise/light  conditions  throuchout 


each  session.  Full  cooperation  v/as  experienced  from  the  other 
users  of  the  C3  wargaming  laboratory,  and  a  stable,  cont.rclleo 
experimental  atmosphere  maintained  (see  Figure  6.1,  Chapter  VI, 
for  a  complete  Laboratory  Layout) . 

D.  SCHEDULING  OF  SESSIONS 

The  NVJISS  experiment  took  place  in  the  C3  warcam.ing  laboratory 
at  the  Naval  Postgraduate  School.  It  was  intended  to  be  run  in 
lieu  of  the  subjects  scheduled  laboratory  period  for  their  OS 
3603  course.  The  subjects  would  participate  individually  in  four 
sessions;  each  run  v/as  scheduled  to  last  for  40  minutes.  A  short 
br ief /debr ief  period  would  make  the  entire  session  approximately 
50  minutes  in  total  length. 

The  experiment  was  conducted  from  15  October  85  through  28 
October  85,  and  during  that  period  a  total  of  96  sessions  were 
recorded.  The  C3  laboratory  proved  to  be  an  ideal  location  for 
the  experiment.  Because  the  NWISS  game  is  resident  on  the  VAX 
11/780,  and  the  VAX,  the  VEPvBEX  3000  and  the  Macintosh  computers 
we  re  all  located  in  the  same  laboratory,  they  were  all  easily 
configured  and  able  to  communicate  well  with  each  other. 

The  experiment  was  conducted  early  in  the  Fall  academic 
quarter  to  alleviate  traffic  congestion  throughout  the  laboratory 
by  non-participants.  Since  the  laboratory  was  aividea  into  three 
equal  bays,  each  player  was  completely  separated  from  the  other 
player,  and  in  almost  total  isolation  from  other  laboratory  users. 

Actual  scheduling  v/as  done  on  a  random  basis,  and  chances 
were  only  made  if  conflicts  arose  betv/een  team  members.  The 
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appreciated  as  only  a  few  last  minute  chances  i;ac  to  te  race.  See 
Appencix  S  for  a  complete  listing  of  subjects,  anc  the  actual 
experiment  schedule  of  sessions.  [Ref.  16] 

E.  SCENARIO/ENVIRONMENT  SEQUENCE 

A  separate  scenario  and  environmental  condition  was  assignee 
for  each  session,  and  each  team  played  the  MvISS  under  all  four 
combinations.  For  example.  Team  4  played  the  NWISS  using  Scenario 
A  and  Condition  4,  Scenario  B  ana  Concition  3,  Scenario  C  ar.o 
Condition  2,  and  finally  Scenario  D  and  Condition  1.  The  order  of 
assigning  scenarios  was  counterbalanced  for  sequential  positioning, 
and  for  both  prececing  and  following  treatment  effects.  [Ref. 
17]  (See  KEY  in  Appendix  E.) 

The  assigning  of  environmental  conditions  was  also  aojustec. 
using  the  same  methodology.  The  schedule  was  achered  to  as  closely 
as  possible,  and  even  v/ith  three  separate  last  minute  session 
chances,  all  subjects  played  each  scenario  anc  environmental 
condition  once. 

P.  CONSTRAINTS 

Due  to  its  secure  environment,  anc  the  fact  that  all  the 
wargaming  scenarios  were  already  available  on  the  VAX  computer, 
the  C3  laboratory  was  the  perfect  place  for  running  military 
wargames.  Nevertheless,  certain  features  inherent  to  the  laboratory 
itself  led  to  the  following  constraints  during  the  experiment: 

1.  NRISS  is  the  only  wargame  available  at  the  NPS  that  has 
the  software  available  to  allow  the  use  of  the  VERB  LX 


3000  ecuipir.ent  for  the  input  of  voice  ccnxands .  The 
experiment  was  therefore  constrained  to  using  the  Vt'KDEX 
3000  syster:  for  the  continuous  voice  input. 

2.  The  physical  layout  of  the  laboratory  itself  restricted 
the  placement  of  the  VEKBEX  3000  and  Macintosh  in;  ut 
devices  to  keep  a  lighted  section  of  the  laboratory  c-pen 
fcr  other  stuoent  use. 

3.  The  versatility  of  the  laboratory  allov/s  it  to  be  usee 
for  a  myriad  of  student/instructor  projects.  Eecause  of 
this  fact  the  experiment  hac  to  be  conducted  at  a  tine 
when  the  laboratory  could  be  exclusively  reserved,  to 
prevent  interference  with  the  established  environmental 
conditions.  As  a  result,  it  was  necessary  to  complete 
the  experiment  in  October.  Additionally,  the  sessions 
had  to  be  designed  to  coincide  with  the  regularly  scheduled 
laboratory  periods  of  the  OS  4602  students  in  order  rot 
to  conflict  with  their  individual  schedules.  The  combination 
of  all  these  particular  constraints  prudently  limited  the 
actual  sessions  to  four  per  subject.  Each  session  lasted 
approximately  50  minutes  to  allow  sufficient  time  to 
properly  brief  the  subjects  and  collect  pertinent  data. 

4.  The  subjects  were  randomly  selectee,  and  permanently 
assigned  to  only  one  mode  of  command  input  due  to  the 
previously  mentioned  tirr;e  constraints,  as  well  as  to 
increase  their  personal  proficiency  with  the  assignee 
input  device. 


G.  TRAINING 


As  delineated  earlier,  all  students  were  assigned  to 
either  the  continuous  voice  recognition  system  (VEKBEX  300C)  or 
the  Macintosh  microcomputer  located  in  the  C3  Wargaming  Laboratory. 
Each  individual  was  given  a  thorough  briefing  on  how  to  use  the 
appropriate  device,  and  how  to  train  the  equipment  to  either 
recognize  their  unique  utterances  of  the  designated  NWISS  commands 
(for  the  voice),  or  enter  the  necessary  commands  selected  from 
the  appropriate  "drop-down"  display  window  (for  the  Macintosh) . 


ronr.er. 


Normal  laboratory  lighting  ccnaiticns  v;ere  allcwec  through¬ 
out  the  training  sessions.  This  normal  level  of  one  to  two  fcot- 
lamberts  woulo  be  employed  curing  two  ct  the  experiment ' s  four 
simulated  environmental  conditions,  anc  simultaneously  facilitatec 
NWISS  phraseology  reference  for  the  user's  refariliar ization/ 
retention . 

A  cassette  tape  supplied  continuous  background  noise  at 
a  level  of  sixty-five  decibels.  A  previous  voice  experiment  hao 
Determined  a  direct  correlation  between  the  consistent  use  of 
this  decibel  noise  setting  and  the  best  possible  climate  for 
voice  recognition.  [Ref.  18]  Besides  its  acceptance  as  the  best 
noise  level  for  recognition  accuracy,  it  was  discovered  that  the 
background  noise  with  the  presence  of  a  fixed  air  vent  recirculation 
fan  would  provide  the  minimum  level  of  noise  present  throughout 
the  course  of  the  experiment. 


To  allow  the  VERBEX  3000  system  to  react  properly  to  the 
150  preprogrammea  NV.ISS  command  words,  it  v/as  necessary  for  all 
aesignated  voice  subjects  to  engage  in  two  specific  phases  cf 
vcice  recognition  conditioning.  The  first  phase  recuirec  the 
consistent  repetitious  uttering  of  all  150  words  indiviaually  in 
order  to  allow  the  VERBEX  3000  unit  to  logically  associate  each 
word  with  each  users  unique  voice  characteristics,  ano  then 
physically  enroll  this  "transformed"  version  of  the  word  into  its 


memory  for  later  recall/recognition.  This  procedure  took  an 


average  of  40  minutes  for  each  user,  a  no  although  a  standardized 
pronounciation  of  the  word  was  supplied  and  encouracec  ,  tne 
subjects  were  free  to  substitute  any  utterance  they  c.esirec.  for 
the  YEFBEX  3000  prompt  (if  it  was  remember ec  and  usee  curing  tit- 
actual  warcaming  sessions).  In  the  secono  phase,  a  maximum  of 
three  of  the  150  possible  utterances  v/ere  concatenated,  anu  then 
groupea  by  similar  usage  into  nine  specific  grammars  or  sections. 
Each  partial  command  phrase  v/as  then  repeated  continuously,  and 
as  consistently  as  possible  (using  voice  inflection  and  volume 
control  sin ultaneously  )  by  the  user.  By  design,  each  utterance 
v/as  repeated  approximately  20-23  times  in  different  sets  within  a 
specific  grammar.  It  was  also  recognized  that  although  some  of 
the  utterances  v/ere  unique  to  a  specific  grammar,  commands  such 
as  "Control_K"  were  common  to  all  grammars,  and  therefore  trainee 
more  than  the  rest.  This  phase  was  the  most  demanding  anc.  repetitive 
in  nature,  and  required  approximately  5.5  hours  to  complete. 
[Ref.  19] 

At  the  conclusion  of  the  enrollment  and  training  phases 
each  individual  received  a  30  minute  practice  session  while 
interfacing  with  an  KWISS  warcaming  sample  scenario.  This  was  a 
nonitored  exercise  stressing  verbal  consistency,  volume  control 
and  refamiliarization  with  NWISS  commands.  For  a  complete  listing 
of  all  the  grammars,  the  individual  procedures  involved  with 
introaucing  personnel  to  the  environment  and  all  of  the  individual 
worcis  that  were  enrolled,  refer  to  the  NtvISS/VEEBEX  3000  Users 
Guide,  Appendix  F. 


While  command  input  accuracy  in  the  vcice  environrenr  is 
basec  or.  repetition  coupled  with  consistency,  the  point  select 


rethoc  inherent  in  Macintosh's  reuse  recuires  manual  c.e;:ter  it'- 
ano  practiced  digit  manipulation.  To  allow  the  Macintosh  user  to 
interface  with  the  wargaming  scenario  resident  on  the  VAX  computer, 
a  program  was  written  in  the  language  BASIC  to  provide  the  user 
with  command  w ores  from  a  limited  vocabulary.  The  program  sinulates 
the  VT10G  terminal  in  that  it  allows  information  communicatee  to 
the  VAX  to  be  displayed  on  the  screen  for  analysis.  It  pern  its 
the  sequential  selection  of  words  anc  limited  phrases  through  an 
appropriate  column  header  and  its  associatec  "arop-dewn"  window; 
all  operated  and  selected  via  mouse  technology.  A  capability  also 
exists  for  the  user  to  enter  the  manual  iroce  anc:  type  commands  to 
the  computer  using  the  attached  keyboard. 

Training  for  the  Macintosh  was  accomplished  in  an  "offline" 
mode  which  allowed  the  user  to  make  full  use  of  all  operational 
commands,  without  the  response  of  the  VAX  computer.  Each  user  was 
given  a  15  minute  orientation  brief  on  the  use  of  the  mouse,  anc: 
the  subsequent  self-generated  training  in  command  selection 
aver agea  35-50  minutes. 

H.  PRACTICE  SESSIONS 

1.  Initial  Individual  Tasks 

After  training  their  individual  speech  patterns  the 
subjects  were  given  written  instructions  on  how  to  bring  up  the 
NWISS  game  and  initialize  the  VEPBEX  3000  ana  Macintosh 


microcomputer .  They  were  given  a  list  of  approximately  50  separate 


KU'ISS  tasks  to  perform  by  issuing  commands  using  voice  anc  the  mouse 


peripheral  input.  While  the  lists  were  Different  for  tne  continuous 


anc  Macintosh  inputs  because  force  names  anu  call  signs  we :  •: 


Different,  the  general  set  of  tasks  v/ere  the  sane.  The  tasks  vote 


very  specific  in  nature  to  require  the  subjects  to  put  then  into 


acceptable  NWISS  format,  and  then  enter  the  corranos  as  a  reccc- 


nizable  speech  cr  Macintosh  input. 


There  were  several  purposes  for  the  individual  practice 


sessions  described  above;  especially  for  the  VERBEX  3000  users. 


It  helped  to  identify  problems  with  recognition  (so  that  subjects 


could  retrain  vocabulary/refresh  their  memories),  and  it  was 


useful  in  teaching  subjects  to  take  a  general  task  and  convert  it 


into  NWISS  format.  This  was  especially  important  for  VEFBEX  3C0C 


users  in  that  the  necessary  pauses  between  phrases  were  requireo 


for  the  different  grammars.  Most  users  initially  thought  they 


were  having  recognition  problems,  when  in  fact  they  were  net 


pausing  in  the  proper  places.  The  authors  participated  in  these 


practice  sessions  (one  on  the  VERBEX  3000  and  one  on  the  Macintosh) 


so  that  a  better  feel  for  the  problems  encountered  by  the  subjects 


could  be  experienced  first  hand.  [Ref.  2] 


Enhancement  of  the  experimental  design  was  achieved  by  using 


subject  training  that  allowed  the  identification  of  "obscure" 


NWISS  vocabulary  not  often  trained  by  the  VERBEX  300C  users;  or 


inadvertently  overlooked  by  the  Macintosh  subjects.  There  was  an 


additional  problem  with  VERBEX  3000  because  while  an  individual 


,>  r*  -  *  •  \  *  v  m."  «,  ■»  *  **  *  *  ------ 


;ora  ray  :.«v«  teen  trainee .  it:  may  not  rave  teen  irc.uie, 
rar.:r-ars  or  pr. rases.  These  imposed  limitations  w ere  •.  a . 

■riario  design  p  r  a : 
tneir  thesis,  nru  since  the  sate  scenarios  ;:»-re  uses  ;  r.  t:  :  . 
tresis  trvy  were  also  foil  y  it  ccr;  oratec. 

2 .  WIVc  Practice  Sessions 

All  subjects  went  through  a  practice  ‘.'l.'ISS  session  before 
the  actual  experimental  testing,  and  (as  described  in  Chatter  VI) 
all  subjects  were  assigned  to  either  continuous  voice,  i'acirtosn 
microcomputer  or  keyboard  entry.  There  were  several  reasons  for 
this  practice  session.  Since  all  of  subjects  had  recently  complete^ 
a  separate  classroorr.  experiment  using  HVilSS.  it  was  necessary  tc 
r  e  f  ami  1  i  arize  the  voice  users  with  the  names  of  the  forces  for 
which  they  hac  previously  trainee  their  voice  patterns.  In  addition, 
it  was  found  that  in  the  majority  of  cases  (cue  to  the  la  re¬ 
number  of  students  present  in  each  group),  all  the  subjects  were 
not  able  to  rotate  through  the  specific  position  that  allowed 
then,  to  actually  input  commands  during  the  running,  of  the  session. 
This  sample  scenario  gave  each  individual  an  inkling  of  the  type 
of  commands  to  be  performed  during  the  actual  experiment.  All 
sucjects  had  access  to  status  boards  showing  their  available 
forces,  which  made  the  remembering  of  names  less  of  problem  witr. 
cor. tiriued  practice. 

The  practice  sessions  proved  to  be  very  instructive  for  the 
autr.ors  during  the  actual  preparation  for  the  experiment.  These 
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observance  of  all  the  croups  in  a  "ary  run"  insured  that  procedures 
usea  later  voula  be  acceptable.  It  also  served  to  verify  that 
there  was  ample  time  to  complete  the  session  and  gather  resultant 
data  ir.  the  scheduled  50  minute  periccs.  Ml  environmental  conditions 
were  examined,  and  the  correct  positioning  of  stereo  speakers  anc: 
settings  on  rheostats  was  noted  to  insure  equal  noise  anc  light 
at  both  positions.  This  also  served  to  insure  that  the  settings 
coulc  be  easily  duplicated  during  the  actual  sessions. 


The  authors  had  prepared  the  laboratory  before  the  subjects 
arrival  so  that  all  equipment  was  turned  on,  the  appropriate 
NWISS  scenario  was  initialized  and  placed  in  pause  mode  and  the 
voice  patterns  for  the  intended  VERBEX  3000  user  were  leaded  into 
the  system.  A  command  to  save  the  session  was  induced  for  post 
analysis  to  insure  that  the  desired  data  w as  actually  being 
collected . 

Before  the  start  of  the  practice  session,  the  subjects  were 
given  an  administrative  briefing  about  the  practice  run,  anc 
concerning  specific  instructions  for  the  test  sessions.  The  exact 
items  covered  are  shown  in  Appendix  C.  Following  the  administrative 
briefing,  the  subjects  were  briefed  on  the  particular  practice 
scenario.  Each  individual  was  supplied  with  a  sample  list  of 
NWISS  commands  to  be  used  for  reference  during  the  session,  if 
neeaeo.  A  verbal  briefing  on  the  mission  w as  also  given  to  all 
subjects,  and  any  Questions  were  answered. 


—  a*-  *  -  •'  -  j*  -  V  ^  jt* -ji*  -  a*,  .  m"  -V- 


Tne  t> W I S S  care  was  allowed  to  run  for  approximately  30 
minutes.  At  the  completion,  the  subjects  departed  anc,  if  another 
croup  was  to  come  in,  the  authors  preparec  the  laboratory  acccrc- 
incly .  Acait ionally ,  copies  of  the  photcoraphec.  care  screens 
were  printed  at  this  time.  As  was  previously  mentioned  this 
procedure  was  only  performed  for  the  first  few  sessions  to  verify 
correct  information,  ano  to  determine  how  lone  the  entire  analysis 
process  would  take.  Printouts  were  not  necessary  for  all  the 
practice  sessions  because  the  data  would  not  be  used  in  the  experiment. 


[♦JO  I*. 


tUCT  OF  THE  EXPERIMENT 

A.  INTRODUCTION 

This  charter  will  Describe  the  layout  ana  control  ci  the 
laboratory,  the  actual  concuct  or  the  experiment  a  no  the  retr.cb 
used  to  record  the  individual  sessions. 

B.  LABORATORY  ENVIRONMENT 

i.  conf.iflME3tiop 

The  Nt.’ISS  Command  and  Control  laboratory  was  divioed  into 
two  incependent  bays  (each  configured  approximately  sixteen 
feet  high  by  eighteen  feet  in  length)  and  w as  used  to  simulate 
the  environment  for  the  experiment.  The  following  equipment  for 
each  of  the  two  input  modes  was  selectively  located  in  its  respective 
section: 

1)  a  Ramtek  graphics  screen  with  a  separate  stereo  speaker 
beside  it  for  producing  background  noise, 

2)  a  VT100  game  status  terminal  which  v.as  used  tc  retrieve 
game  information  only,  ana 

3)  a  player  terminal  (VT1G2  for  the  Macintosh  or  ADM -31  for 
the  voice)  which  allowed  commands  to  be  physically  enterec 
into  the  computer. 

Using  the  ADM-31  as  a  validation  device  for  character  strings 
enroute  to  the  computer,  the  voice  subjects  we re  able  to  monitor 
their  inputs,  change/cancel  incorrect  entries  ana  use  the  keyboard 
(on  isolated  occasions)  in  the  event  vcice  recognition  proved  to 
be  an  insurmountable  problem.  The  laboratory’s  physical  layout 
provided  the  subjects  with  easy  access  to  all  terminals,  anc  the 
experiment  proctors  coula  evaluate  the  progress  of  each  session 
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using  the  VAX/hWISS  control  station  in  the  Control  Bay.  Acuiticnal 


eouipr.ent  was  locatea  in  each  bay,  but  was  separatee  by  a  partition 

.  net  oirectlv  associatec  with  the  experiment  itself  (see 

.  igure  6.1  for  a  complete  Laboratory  Layout). 

2.  Laboratory  Control 

Personnel  traffic  was  not  restricted  during  the  inuivicual 
vc ice/ Mac intesn  practice  sessions,  but  during  the  actual  tesc 
sessions,  access  to  the  laboratory  was  more  restrictive  ir.  nature. 
While  the  experiment  was  in  progress  all  personnel  were  requested 
to  use  the  rear  entrance  to  preclude  the  distraction  of  the 
pneumatic  sliding  door,  and  to  prevent  undesirable/uncontrolled 
light  from  entering  the  controlled  surroundings.  Laboratory  users 
not  involved  in  the  experiment  were  advised  that  use  of  the 
facility  was  defaulted  to  whatever  noise  and  light  environment 
was  currently  in  use  during  the  experiment.  Due  primarily  to  this 
precautionary  measure,  the  environmental  conditions  which  had 
been  adjusted  and  measured  before  each  run  v/ere  adequately 
preserved. 

C.  TEST  SESSIONS 

The  procedure  for  the  actual  test  sessions  was  an  exact  Dupli¬ 
cation  of  the  practice  sessions.  As  before,  prior  to  the  arrival 
of  the  subjects,  the  proper  KWISS  scenario  was  initialized  am; 
the  voice  patterns  for  the  subjects  scheduled  v/ere  loaded  into 
the  machines  (see  Appendix  E) .  The  subjects  were  briefed  in 
accordance  with  Appendix  C  and  provided  with  a  copy  of  the  applicable 
scenario  for  their  perusal.  Any  peculiarities  within  a  given 


scenario  which  the  subjects  v/oulc  not  normally  have  exper ienced 
previously  were  pcinteo  out,  anc  any  questions  were  answerer-. 

Following  the  briefing,  the  actual  lihISS  session  began.  Alter 
the  subjects  went  to  tr.eir  positions,  the  proper  noise  anc:  iice.tim. 
levels  were  set,  anc  the  game  was  star tec.  All  the  sessions  were 
run  for  forty  minutes.  Personnel  who  had  repeated  difficulties 
v/ere  given  assistance  as  necessary.  At  the  conclusion  of  each 
run,  copies  of  the  game  sessions  were  printed  out  ano  annotatec. 
for  later  classification.  The  forty  irinute  game  time  pcint  was 
noted  on  the  printouts,  and  the  number  of  commands  and  "Control_K ' s" 
entered  v/ere  computed.  [Ref.  2j 

While  the  majority  of  the  experiment  sessions  were  completed 
as  planned,  seme  rescheduling  was  needed  due  to  the  absence  of 
personnel,  or  to  some  unexpected  NWISS  game  problems.  Rescheduling 
of  personnel  created  no  particular  problems  because  each  input 
method  was  used  to  play  an  individual  KV7ISS  session,  and  the 
proper  scenario  and  environmental  conditions  could  be  reset  for 
any  individual  makeup  as  required. 


A.  INTRODUCTION 


The  purpose  of  this  experiment  was  to  evaluate  the  effectiveness 
oi  two  computer  input  cevices  oncer  various  environmental  concisions. 
Since  a  waccar.e  scenario  was  usee,  the  conditions  sinulatec; 
tactical  or  Command  Information  Center  (CIC)  environr.  ents .  The 
hypothesis  for  the  experiment  was  there  woulc  be  nc  significant 
difference  betv/een  using  the  VERBEX  3000 ,  the  Macintosh  or  the 
keyboard1,  systems.  As  stated  earlier,  the  results  were  based  on 
the  positive  Measure  of  Effectiveness  of  comparing  the  total 
number  of  commands  entered,  and  the  total  number  of  mistakes  made 
while  entering  the  commands. 

B.  DATA  SUMMARY 

The  number  of  commands  entered  was  determined  by  summing  the 
"order  entered"  lines.  As  previously  noted,  the  only  exception 
was  the  aircraft  launch  sequence  v/hich  was  counted  as  either  four 
or  five;  depending  on  whether  or  not  "weapons  were  loacec".  The 
mistakes  were  determined  by  summing  the  applicable  Control_K's 
that  were  correctly  and  deliberately  entered.  Raw  data  for  tne 
experiment  is  listed  in  Appendix  E. 

Table  7.1  is  the  key  which  describes  the  environmental  conaiticns 
used  in  the  experiment.  It  should  be  used  as  a  reference  when 
analyzing  the  other  accompanying  tables  and  figures  in  this  chapter. 


TABLE  7.1 


:.c: 


LOG 

HIGH 


ENVIRGMNENTAL  CCNDITIGES 

6 5  Decibels  (cb) 

85  Deciceis 


LIGHT: 


NORMAL  -  1  Foot-lamber t 
LCV;  -  .05  Foot-lanbert 


Table  7.2  summarizes  the  mean  number  of  commands  enterec, 
based  on  the  variable  ncise/liaht  conditions.  Figure  7.1  aisplays 
the  data  in  graphic  form. 


TABLE  7.2 


MEAN  NUMEER  CF  COMMANDS  ENTERED 
Environmental  Condition:  Noise/Light 


Input 

Device 

Low 

Morn; 

Std 

Dev 

Low 

Low 

Std 

Dev 

High 

Norm 

Sta 

Dev 

High 

Low 

Stc 

Dev 

A  vc 

Verbex 

55.3 

23.4 

69.8 

23.4 

40.8 

15.6 

60.7 

27.3 

56.7 

Mac  intosn 

28.2 

9.4 

43.4 

44.4 

16.8 

47.2 

11.8 

40.8 

Keyboard 

74.1 

15.9 

71.7 

19.6 

79.0 

27.8 

71.5 

19.5 

74.1 

COMMANDS  ENTERED 


Table  7.3  summarizes  tie  Mean  burster  cl  Control_K's  enter  c-c., 
based  or.  the  variable  ncise/licht  conditions.  Figure  7.2  cisclav* 
the  data  in  grannie  for  it. 


TABLE  7 . 3 

MEAL  LUMBER  OF  COLTROL_K'S  ENTERED 
Environmental  Condition:  Noise/Licht 


Input 

Low 

Std 

Low 

Std 

High 

Std 

High 

Std 

Device 

Norm 

Dev 

Low 

Dev 

Norm 

Dev 

Low 

Dev 

7.VC 

Ver  be:s 

8.3 

8.7 

4.5 

2.3 

5.3 

3.8 

5.3 

4.1 

5.9 

Macintosh 

• 

00 

3.7 

5.8 

2.4 

6.2 

3.5 

7.8 

4.2 

6.9 

Keyboard 

5.6 

4.3 

7.7 

00 

• 

o 

7.6 

3.6 

7.3 

6.4 

7.0 

Table  7.4  summarizes  the  Mean  Number  of  Commands  entered  basec 
on  the  trial  number.  Figure  7.3  displays  the  data  in  graphic  form. 
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Figure  7.2  Mean  Control  K’s  Entered 
Environmental  Conditions 


TRtAL  NUMBER 


VERBEX 

MACINTOSH 


KEYBOARD 


C.  STATISTICAL  METHODS 

Cnee  the  data  front  the  experiment  was  compiled,  two-way  analysis 
of  variance  techniques  helped  evaluate  the  results.  Tvc  statistical 
analysis  software  programs  resioer.t  in  the  if  r:  3033  mainf  r:r  t: 
computer  were  usee  to  facilitate  the  calculations.  The  first  was 
tilMTAB,  anc  the  second  was  the  Statistical  Analysis  System 
(SAS)  . 

In  testing  analysis  of  variance  the  following  two  assumptions 
must  be  rr.aoe:  1)  the  populations  from,  which  the  samples  care  can 
be  approximated  closely  with  norn.al  aistr ibutiens ,  ana  2)  they 
all  have  the  same  variance.  [Fef.  2C]  For  each  case,  the  hypothesis 
was  testec:  at  a  confidence  level  of  95  percent.  Additionally ,  for 
each  environmental  condition  (i.e.,  ncise/light  level),  a  ratio  of 
the  number  of  errors  that  can  be  expected  per  the  number  of  valic. 
commands  entered  was  calculateo.  This  was  computed  for  each  of 
the  three  input  devices.  Finally,  an  analysis  using  SAS  was 
conductec  as  a  backup  for  some  of  the  data  that  was  analyzed 
using  the  MIMTAB  program.  [Ref.  21) 

D.  ANALYSIS 

1*  Introouction 

As  with  the  statistical  analysis,  it  is  desirable  to  use 
as  many  data  samples  as  possible.  Since  it  was  difficult  tc 
cor.jr.it  a  large  number  of  subjects  to  the  experinent,  each  of  the 
24  subjects  participated  in  four  separate  sessions,  thereby 
totaling  9G  samples  (VERBLX  3000  ana  Macintosh)  .  Again,  the 
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keyboard  data  v/as  that  which  was  compiled  from  the  Wr  ight/banscn 
exper  indent. 

It  was  now  important  to  ensure  that  the  scenarios  were 
var ieo  enough  to  be  an  "independent  session"  for  the  subjects,  sc 
that  no  unfair  advantage  would  cccur  during  a  trial  run.  The 
two-way  analysis  of  variance  v/as  obtained  between  the  number  of 
corr.nands  entered  ana  the  different  scenarios  used.  Also,  a  tv/o-way 
analysis  was  conducted  between  the  number  of  Control_K‘s  entered 
and  the  different  scenarios  used.  The  result  was  the  same  for 
each,  which  indicated  that  neither  one  exhibited  any  significant 
difference.  It  is  therefore  reasonable  to  assume  that  the  experiment 
consisted  of  96  individual  sessions.  The  Wr ight/Kanson  experiment 
consisted  of  13  keyboard  operators  who  also  played  the  identical 
set  of  4  different  scenarios  (totalling  52).  The  combined  total 
is  then  148  sessions  (samples)  for  this  experiment. 

2.  Best,,  Lql  Each  Input  tiethop 

It  was  expected  that,  each  input  device  would  do  better 
under  a  specific  combination  of  environmental  conditions.  For  two 
of  three  devices  the  results  also  showed  that  the  combination 
that  provided  the  greatest  number  of  valid  commands  to  be  entered, 
also  provided  the  fev/est  number  of  errors  (i.e.,  Control_K '  s )  . 
This  is  a  desireo  situation  and  is  reasonably  intuitive.  What 
follows  is  a  brief  description  of  the  best  environment  found  for 
each  particular  input  method.  See  Figure  7.5  for  a  listing  of  the 
ratios  (errors  per  valia  commanas)  for  each  device. 


68 


v*v'vV-/v'  v.  v/ 


For  the  Vt'RBLX  3000  system  the  greatest  number  of  valic 
commands  were  entered  under  a  low  noise,  low  light  ccnoition. 
Concurrently,  the  fev/est  errors  were  entered  under  these  exact 
conditions.  Based  on  the  F  ratios  calculated  after  r erf  or mint  a 
two-way  analysis  of  variance  (at  the  95  percent  level),  tnere  was 
NO  significant  difference  between  the  number  of  commands  entered 
ano  the  environmental  conditions.  The  same  result  was  realised 
(NO  significant  difference)  between  the  number  of  Controi_K's 
(errors  inputed)  and  the  environmental  conditions.  That  is, 
although  there  is  a  "lowest  ratio"  for  the  VERBEX  3000  system, 
there  is  NO  significant  difference  between  the  number  of  commands 
entered  or  errors  entered,  and  the  environmental  conditions  under 
which  it  was  used.  As  expected,  the  lowest  ratio  (errors  per 
valid  command  entries)  came  under  the  same  lew  noise,  low  light 
condition.  (See  Appendix  E  for  actual  Statistical  Data.) 

For  the  keyboard  system,  the  highest  number  of  valid 
commands  were  entered  under  two  conditions:  1)  lew  ncice  and 
normal  lighting,  and  2)  low  noise  and  lew  lighting.  Fere'  again, 
the  fewest  number  of  errors  were  made  under  low  noise  and  normal 
lighting  conditions.  Like  the  VERBEX  3000,  the  F  ratio  calculated 
from  the  two-way  analysis  of  variance  revealed  NO  significant 
difference  between  the  number  cf  commands  entered  (and  the  number 
of  Control_K's  entered)  and  the  environmental  condition.  Never¬ 
theless,  the  lowest  ratio  occurred  under  a  low  noise,  norm.al 
lighting  condition. 


For  the 


Facintoi  h.  the  nigr.est  number  cf  vaiia  cc::.:,2:.u: 
w  ere  enterec  under  k  i h  noise,  low  li  u:tir,;  conditions.  The 
fewest  number  of  errors  were  entered  under  lew  noise,  lev.  1;  ;.t 
concitions.  As  with  the  previous  input  devices,  NO  sign: flea:  t 
difference  was  revealed  between  the  number  of  ccm:.  sr.^s  er  ter-  _ 
(or  the  number  of  errors  entered)  and  the  environmental  co.noit  io  r 
used.  Here,  the  lowest  ratio  occurred  while  operatinb  ur.oer  lew 
noise  and  low  lighting  conditions. 

3.  Best  Incut  Method  for  Each  Environment 

This  question  was  answered  using  a  two-way  analysis  of 
variance.  Each  environmental  condition  (i.e.,  noise/light)  should 
reveal  a  desired  input  device  which  yields  the  largest  number  of 
commands,  and  also  the  fewest  number  of  errors.  As  in  the  previous 
question,  the  ratio  of  errors  to  valid  cor.manus  also  revealed 
some  practical  insight  into  which  device  may  be  preferable  when 
using  a  particular  noise/light  condition.  The  two  hypotheses 
stated  that  the  number  of  commands  entered  (and  the  number  cf 
Contrcl_K’s  committed)  would  be  equal  for  all  three  input  devices. 

Conclusive  results  (based  on  the  F  ratio  at  95  percent) 
slow  there  IS  a  significant  difference  between  the  number  of 
cor:. rands  entered  and  the  input  crevices.  In  all  four  noise/light 
conditions  the  keyboard  operators  entered  more  commands  than  all 
trie  other  subjects.  This  was  not  the  case,  however,  when  a  measure¬ 


ment  of  tne  number  of  Control_K's  committed  was  taken.  Here,  the 
two-way  analysis  of  variance  revealed  no  significant  difference 
among  any  noise/light  condition  anc  the  input  devices.  Even  on 


examining  the  raw  data  it  was  shown  that  NO  clear  acvar.tace 
existec  for  any  particular  oevice.  The  calculated  ratios  (see 
Figure  7.5)  aisplavec  the  following  advantages  under  each  environ¬ 
mental  conc.it  ion: 


1.  Low  Noise  /  Normal  Light  -  KEYBOARD 

2.  Low  Noise  /  Low  Light -  VLRBEX 

3.  High  Noise  /  Normal  Light  — - -  KEYBOARD 

4.  High  Noise  /  Low  Light -  VERBEX 


This  question  was  answered  using  a  one-way  analysis  or 
variance.  The  F  ratio  was  again  calculated  at  a  95  percent  confidence 
interval,  and  the  hypotheses  were  the  same  as  the  ones  cescribec 
in  the  previous  question. 

The  results  revealed  a  significant  difference  between  the 
mean  number  of  commands  entered  and  the  input  devices,  thereby 
rejecting  the  null  hypothesis.  The  raw  data  showed  that  the 
heyboc.ro  operators  entered  more  commands  than  the  operators  of 
the  other  devices.  The  VERBEX  3000  players  were  only  slightly 
lower,  while  the  Macintosh  players  entered  an  average  of  43 
percent  fewer  commands  per  session. 


As  far  as  the  number  of  errors  committed  was  concernec, 
the  one-way  analysis  of  variance  showeo  NO  significant  aifference; 
thereby  accepting  the  null  hypothesis  that  the  number  of  Control_K's 
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entered  by  all  three  input  cevices  was  equal.  The  raw  cata  she  wet. 
only  a  difference  of  2  or  3  errors  amongst  input  devices  per  each 
session.  The  VFF:F-KX  3000  hac  the  fev/est  (an  average  or  5 .  b )  ,  next 
was  the  Macintosh  (with  6.9),  and  finally  the  keyboard  (with  h.i). 

5.  Possible  Learning  Curves 

It  was  interesting  to  note  that  NO  significant  learning 
curve  took  place  between  the  subjects  w hen  consic.ering  either 
the  nurter  of  commands  entered,  or  the  number  cf  Control_K's 
committed.  It  is  worth  mentioning,  hov/ever,  that  the  Macintosh 
subjects  increased  the  number  of  commands  entered  for  each  succeeoing 
trial  (session).  This  can  be  seen  graphically  depicted  in  Figure 
7.3.  The  reverse  w as  not  the  same  for  the  number  of  Control_K's 
that  the  subjects  entered,  and  again,  neither  v/as  it  significant 
(this  can  be  seen  graphically  in  Figure  7.4). 

E.  SUMMARY 

To  summarize,  there  were  few  significant  results.  Fven  with 
the  aoceo  benefit  of  looking  at  the  raw  oata,  not  all  the  questions 
were  answerec  unequivocally.  None  of  the  three  input  cevices 
could  be  labeled  as  a  clear-cut  winner  over  any  of  the  other 
devices.  Each  of  the  cevices  performed  best  given  a  specific  set 
of  environr ental  conaitions.  Odcly  enough,  the  V  El!  BEX  3000  ana 
Macintosh  both  performed  best  in  the  Low  Kcise/Lcw  Light  conditions, 
ana  the  keyboard  performed  the  best  in  the  High  Noise/ Normal 
Light  conditions.  Without  regard  to  the  Noise/Light  conditions, 
the  VLPBEX  3000  system  had  the  lowest  ratio  (i.e.,  error  to  ccrranc)  , 
with  the  keyboard  a  close  second  (.102  to  .112  respectively).  The 
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Macintosh  enterec  fewer  cor.r.ands  than  the  others,  anc.  was  runi.ee. 
seccnc  when  measuring  the  nur.bers  of  errors  committee.  Accitiona]  ly , 
no  siann leant  learning  took  place  curing  the  four  Generate 
sessions  that  each  inoivicual  participatec  in  curing  the  enuer  lr.  enr. . 


A.  INTRODUCTION 

The  cojective  of  tnis  thesis  was  to  evaluate  different  inr-ut 
interlaces  to  the  I.WTSS  vargairinc  scenarios  resident  or.  t»ie  ' 
11/780  computer.  The  two  hypotneses  were  that  the  mean  number  cr 
corn. anas  entered  ana  the  mean  number  of  errors  corrrittea  (using 
any  of  the  three  tested  input  devices)  would  be  equivalent,  while 
the  objectives  of  the  thesis  were  successfully  established  on  the 
completion  of  the  experiment,  no  single  input  device  can  be 
designated  as  the  "better"  of  the  three. 

B.  CONCLUSIONS 

Before  the  experiment,  the  authors  of  this  thesis  anticipated 
that  the  vcice  system  v/ould  outperform  the  other  devices.  By  the 
term  "outperform",  it  is  meant  that  the  VERBEX  3000  subjects 
v/ould  enter  significantly  more  commands  and  commit  fev/er  overall 
errors  than  the  other  devices.  It  was  expecteo  that  the  Macintosh 
v/oulo  outperform  the  keyboard  simply  by  virtue  of  its  current 
technology.  In  general,  the  analysis  of  the  data  did  not  confirm 
these  expected  outcomes. 

Many  reasons  can  be  given  to  explain  these  unexpected  results. 
As  far  as  the  keyboard  v/as  ccncernea,  most  of  the  subjects  wastes 
little  tine  in  moving  their  keyboards  as  close  as  possible  to 
their  oata  input  (CRT)  screen  in  the  low  light  condition.  Using 
the  viceo  screens  inherent  glcw  helped  considerably  in  locating 
the  correct  keys;  especially  for  the  non-typists.  Also,  a  post 


experiment  survey  revealeci  that  the  keyboarc  operators  were 
experienced  typists  by  anc  large.  Ey  this  it  is  meant  that  at 
worst  rest  of  the  subjects  were  able  to  use  both  hancs  while  oniv 
occasionally  looking  at  the  keys.  Bv  inplication,  rrilitary  cnicer 
postgraduate  students  are  collectively  r.iore  likely  to  have  hoc 
typing  experience  (i.e.,  used  typing  skills  during  their  lengthy 
education/training)  than  the  general  population.  Their  average 
lifetime  exposure  to  keyboard  technology  is  high,  and  again  this 
particular  croup  was  above  the  norm.  [Ref.  2]  Or.  the  other 
hano,  none  of  the  subjects  had  prior  experience  v/ith  either  the 
continuous  vcice  system,  and  only  a  few  subjects  had  prior  experience 
with  the  Macintosh  microcomputer  system.  This  brings  into  focus 
the  implications  of  the  necessary  training  involved  for  each 
device.  The  verblx  3000  subjects  trained  with  the  voice  system:  ar 
average  of  six  hours  only  one  week  before  the  experiment.  Considering 
that  it  takes  years  of  frequent  typing  to  become  proficient,  the 
VBRBEX  3000  subjects  did  v/ell  to  keep  up  with  the  keyboard  operators. 
The  Macintosh  subjects  practiced  for  about  35  minutes  each, 
concentrating  totally  on  developing  the  motor  skills  necessary  to 
maneuver  the  arrow  using  the  mouse  peripheral.  In  retrospect,  it 
is  felt  that  they  would  have  performed  considerably  wetter  if 
they  had  been  as  proficient  (through  additional  training)  in  the 
use  of  the  mouse  as  the  keyboard  subjects  were  in  using  their 
acquired  typing  skills.  The  raw  data  from  the  Macintosh  players 
showed  a  slight  increase  in  the  mean  number  of  commands  entered 
for  each  individuals'  succeeding  trial.  Although  it  was  not  a 
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sicnicicant  increase,  tne  sane  statement  coulc  net  be  mace  for 
tne  other  devices. 

l:hen  locking  at  the  ratios  (see  Figure  7 .5) ,  each  device 
performed  veil  under  certain  noise/light  conditions.  The  VERLLM 
3C00  anc  the  Macintosh  hac  the  lowest  error  tc  ccr.nanc  ratio 
under  the  low  noise/lcw  light  conditions.  Not  surprisingly,  the 
keyboard  operators  hac  the  lowest  ratio  under  the  high  noise/norral 
light  conditions.  For  the  keyboard  and  VERBEX  operators,  each  hao 
the  lowest  error  to  comnanc  ratio  in  two  of  the  four  environmental 
conditions.  Looking  specifically  at  the  "light  conditions"  (without 
regard  to  noise)  ,  the  VEREEX  3000  system  had  a  lower  ratio  than 
the  other  devices.  Similarly,  the  keyboard  users  attained  their 
lowest  ratio  under  "normal  light  conditions".  Considering  the 
inexperience  of  the  VERBEX  3000  operators,  they  die.  extremely 
well  in  the  most  likely  high  stress,  wartime  er.vironnent  (high 
noise,  lev/  light).  The  error  to  command  ratio  was  .015  lcv/er  than 
the  second  best,  keyboard. 

Although  we  can  logically  conclude  that  the  keyboard  oic 
perform  better  than  the  other  devices,  it  would  be  illogical  to 
conclude  that  the  other  input  devices  do  not  warrant  further 
research.  Just  looking  specifically  at  noise  conoitions  (without 
regard  to  the  lights)  the  VERBEX  3000  system  hac  a  lower  ratio 
than  the  other  devices.  Considering  the  inexperience  ot  tne 
VERBEX  3000  operators,  their  ratio  was  only  .004  higher  than  the 
keyboard  subjects  in  the  most  likely  high  stress  wartime  environment 
(that  of  high  noise  and  lev/  light  conditions). 


Another  ares  analyzed  was  the  presence  of  any  1  e a r n i  r. trw-n.s 
the  subjects  r.  ay  have  received  from  previous  sessions.  Acre  of 
tre  subjects  perforr.ee  significantly  Letter  ever  ti;e  four  trials. 
Vhile  tr  is  wss  not.  necessarily  an  encour ar.i rr^  trend,  t;  is  result 
supports  the  independence  of  each  session,  ti.eresy 
sample  size  of  the  experiment  itself  mere  valla. 

Cne  final  content  should  be  made  about  the  livelihood  that 
inexperienced  operators  will  often  be  at  the  controls  of  the 
input  media  in  an  academic  or  training  environment.  For  example, 
a  senior  officer  (i.e..  0-5  or  above)  attending  the  .'aval  far 
College  will  play  similar  war  games.  It  is  highly  unlikely  trat 
an  individual  will  have  had  prior  experience  using  speech  or 
"menu-oriented"  systems  for  input  communication.  It  car.  therefore 
be  concluded  that  with  a  minimum  of  introduction  to  these  devices, 
almost  equal  performance  car.  be  attained  to  that  cf  the  experienced 
typist  if  the  syntax  required  of  the  game  commands  is  also  well 
learned  by  the  novice  user. 

C.  RECOMMENDATIONS 

It  is  the  opinion  of  the  authors  that  further  study  is  justified 
concerning  the  potential  of  the  three  input  devices.  Eefcre 
another  experiment  is  performed,  however,  it  is  recommended  that 
sufficient  training  of  the  subjects  be  conducted.  It  was  felt 
that  the  Macintosh  subjects  would  have  performed  significantly 
better  with  more  extensive  training  and  dedicatea  practice  sessions. 
This  would  have  enabled  them  to  become  more  familiar  with  the 


coordination  required  to  effectively  maneuver  the  cursor  with  the 


rr.ouse.  The  probier.:  v/ith  this  proposal  is  the  tine  constraint 
imposed  on  both  the  planning  arc  execution  of  the  excer  iment . 
Opt i rally,  all  subjects  should  be  ecually  skilleo  in  the  use  of 
the  particular  input  cevice. 

Additionally*  the  scftv/are  interface  program  for  the  Macintosh 
shoulc  be  modified  to  facilitate  a  quick,  efficient  and  accurate 
mode  of  input  for  the  user.  This  modification  woulo  recuire  a 
more  natural  arrangement  of  commands  to  allow  an  easier  interaction 
with  the  sequence  of  these  commands  required  by  the  syntax  desicn 
of  the  softv/are. 

Acquisition  costs  for  these  devices  and  any  stuay  of  cost/benefit. 
relationships  would  provide  additional  fertile  ground  for  future 
research.  Current  downward  trends  in  hardware  costs,  and  a  general 
lowering  of  costs  for  all  technologies  which  are  driven  by  micro¬ 
computer  advances  in  the  marketplace,  cause  a  "concept  of  costs" 
for  these  systems  to  be  well  worth  consideration. 

M.'ISS  shoula  be  used  as  a  medium  for  any  further  experimentation. 
The  necessary  peripherals  are  all  established,  ana  it  provides  an 
accurate  simulation  of  a  real-time  environment.  Varying  environ¬ 
mental  conditions  are  easily  simulated  in  the  C3  laboratory,  ana 
the  accessibility  limitation  makes  it  an  ioeal  place  to  conciuct 
further  experiments. 

In  conclusion,  future  experiments  shoula  induce  the  previously- 
suggested  modification  to  the  Macintosh  software  anc  the  most 
advanced  "touch  screen"  and  voice  technology  available.  It  is 
felt  that  these  three  devices  have  the  greatest  potential  to  meet 
the  reauirenents  for  an  efficient  input  medium. 
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D.  SUMMARY 

an's  zeal  to  accomplish  the  ideal  "nan-machine"  interaction 
has  allowed  significant  t  rccress  to  occur  recardino  input  devices . 
Tne  keyboard  './as  first,  anc  has  been  expendable  tut  restrictive ; 
sorretir.es  tc  the  point  cf  being  inconvenient,  fuick  to  appreaen 
popularity  were  several  "non-traditicnal "  methods;  one  being  tne 
voice  system.  The  discrete  voice  system,  is  unnatural  anc  hare  to 
use  for  most  users,  while  the  continuous  system,  is  easier  to  use 
and  more  convenient  for  the  jobs  requiring  user  input  and  manual 
labor  simultaneously.  Two  other  methods  are  the  "pull-ccwn"  menu 
and  the  "touch  screen"  technologies.  Both  have  been  successful 
even  in  their  early  stages  of  development. 

Man  is  quickly  approaching  the  doorstep  cf  Fifth  Generation 
computer  technology.  Therein  lie  "intelligent  systems"  which  will 
give  increasing  flexibility  to  input  devices  of  the  future. 
Unfortunately,  there  can  be  no  "perfect"  universal  input  method 
due  primarily  to  the  varied  reouirenents  and  restrictions  innate 
to  each  individual  job.  Nevertheless,  it  follows  that  cor.tinuec 
research  shoulo  be  aimed  at  producing  a  bcoy  of  knowlecge  whicn 
v/ould  allow  us  to  pick  the  best  method  of  computer  interaction  in 
a  specific  environment.  Although  it  is  recognized  that  computer 
speecs  today  are  restrictec  from  full  use  because  of  the  slcvr.ess 
of  interface  hardv/are,  the  rate  of  progress  in  developing  hign 
speeo  CPUs  is  compounding  the  problem.  Therein  lies  the  impetus 
to  continue  toward  the  development  of  better  inr-ut  meoia. 
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SCENARIO  BRIEFINGS 


SCENARIO  A 


SITUATION:  Hostilities  have  alreaoy  been  declared,  one.  Grance 
forces  are  providing  escort  for  a  large  convoy  of  cargo  snips 
carrying  nuciear/cher.ical  weapons. 

FRIENDLY  FORCES:  You  have  available  one  Aircraft  Carrier,  2  Knox 
class  destroyers,  a  Los  Angeles  class  submarine  (positioneo  north 
of  trie  convoy)  ana  2  flights  of  4  P3C  aircraft. 

N E i'i Y  FORCES:  Orange  forces  have  8  ships  escorting  1C  merchant 
hips  in  the  convoy.  No  air  assets  are  presently  available,  or 
expected . 

FISSION:  Destroy  all  Orange  combatants  without  inflicting  damage 
to  any  cargo  vessels  (due  to  the  nature  of  their  cargo) . 


NOE:  POSITIVE 

—  number  of  weapons  fired  during  the  session 

—  number  of  combatants  identified,  hit  and  damacec/sunk 


NEGATIVE 


number 

of 

merchant  ships  hit/sunk 

number 

of 

Elue 

Aircraft  lost 

number 

of 

Elue 

vessels  hit/sunk 
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LA'-idC:  Ape  re::  in  ateiy  20  Grange  merchant  vessels  are  or.crcrcc. 
pert  v-'aitinc  to  unicac  various  carco.  Host i  1  ities  are  i:  -  inont . 

EM.  IA  FORCES :  Clue  forces  induce  2  P2C  air  era:  t  ar.c  tut 
:u:.s  or  5  /.6L '  s .  An  aircraft  carrier  is  available  to  supr.iv 
tner  air  assets  ir  ceer.ec  necessary. 

FORCES:  Location  and  makeup  of  Orange  forces  is  unoetern.ir.ee 
to  peer  weather / intel  1  iqence  . 

Pic:.:  Destroy  as  many  merchant  ships  as  possible,  anc  attack 
patents  only  if  fireo  upon. 


POSITIVE 


r...:::  er  cl  weapons  fired 

a.,  ret  c  t  merchant  snips  identified,  hit  and  damaged 
-  cor  t:  at  ants  identified,  hit  and  damaged 


r  ce: 


car  acec/lost 


SCENARIO  C 


SITUATION :  There  are  ccnrirr.ec.  reports  that  large  numbers  of 
Orancje  Combatant  units  have  left  port,  are  running  EICON  silent 
arc  are  uni  oc  stable  at  this  t  im.e .  There  are  frienc.lv/nturral 
forces  in  the  neighboring  area  anc.  tension  is  rising.  No  host  il  j  r  ies 
nave  been  declared  as  yet. 

FRIENDLY  FORCES:  1  F3C  aircraft  and  4  F14A  aircraft  are  available. 
Other  assets  are  in  the  area,  but  are  not  oncer  your  oirect 
control.  Any  merchant  ships  enccunterec  are  not  to  be  consioerec 
hostile . 

MISSION:  Search  for  possible  contacts  in  the  area  from  35N  to 
42N,  and  from  174E  to  180E  (or  164E  to  170E  depending  on  the 
oceanic  displacement).  Locate,  identify  and  designate  as  many 
vessels  as  possible  as  either  enemy,  friendly  or  neutral.  Center 
the  plot  upen  the  P3C  at  the  start  of  the  session,  and  weapons 
will  remain  tight  unless  fired  upon. 


HOE:  POSITIVE 


—  number 

—  number 

—  number 


of  Orange  forces  properly  identified 
of  Blue  forces  properly  identified 
of  Neutral  forces  properly  identified 


NEGATIVE 


—  number  of  forces  improperly  designated 

—  number  of  forces  remaining  not  f ounci/proper ly  designated 


to  »T1 


SCENARIO  D 


SITE  AT  ICR':  An  Orange  SAC  is  100  MM  directly  north  or  your  rositicn 
ana  you  are  taskeo  to  intercept  anc  visually  identity  it.  Hostilities 
nave  net  been  declared  as  yet,  but  are  expected  to  break  out  scon . 

KILMDLY  FORCES :  One  Aircraft  Carrier  (with  its  associated  aircraft )  , 
escort  ships  anc;  a  submarine. 

ENEMY  FORCES:  The  strength  of  the  Orange  forces  is  unknown,  cut 
they  are  net  expected  to  have  any  aircraft  launched  at  this  tire. 

MISSION:  Launch  carrier  baseo  assets  to  sea r ch/ icent i f y  the 
suspected  Orange  SAG.  All  weapons  will  remain  tight  unless  firec 
upon. 


MOE:  POSITIVE 


—  number 

—  number 

—  number 


of  aircraft  successfully  launched 
of  enemy  assets  properly  identified 
cf  enemy  assets  damaged  (only  if  fired  upon) 


NEGATIVE 


—  number 

—  number 

—  number 


of  Orange  forces  not  designated  as  enemy 
of  Blue  ships  hit/lcst 
of  Elue  aircraft  lost 
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SUBJECT  ADMINISTRATIVE  BRIEFING 


NOTE:  The  following  administrative  briefing  was  initial]'/  :.iver 
to  each  subject  prior  tc  the  beginning  of  the  experiment .  hey 
points  were  re-emphasized  at  eacn  session  as  applicable . 


1.  The  sessions  would  be  approximately  50  minutes  ir.  Ien0t;;,  eccr. 
subject  would  be  scheduled  for  four  individual  sessions  one.  a 
master  schedule  of  all  sessions  was  posted  on  CDR.  Stewart's 
office  door  for  reference  >  and  to  facilitate  changes  throughou 
the  experiment. 

2.  Subjects  were  asked  to  wait  outside  the  laboratory  until  told 
to  enter.  This  precaution  was  taken  in  order  to  preclude  an 
inadvertent  disturbance  in  the  environment  if  a  previous  group 
session  was  still  in  progress. 

3.  The  voice  patterns  for  the  scheduled  V ERE  EX  3000  subject  were 
already  loaded  to  avoid  any  unnecessary  delay.  The  user  simply 
had  to  set  the  gain  in  order  to  be  ready  to  start  the  session. 

4.  The  noise/light  conditions  for  the  particular  session  were 
explained  and  set. 

5.  The  subject  was  provided  with  the  scenario  for  the  session 
and  all  key  points  were  verbally  emphasized. 

6.  All  subjects  were  advised  to  ask  for  help  during  the  session 
if  any  problems  were  encountered. 

7.  The  subjects  were  asked  not  to  discuss  any  of  the  scenarios 
following  their  sessions  until  the  experiment  was  completeo. 

8.  Each  group  was  reminded  of  their  next  scheduled  laboratory 
period  following  the  completion  of  a  session. 


I 


86 


-  "Execute  BAIPASW" 


-  "Execute  F14STKCAP" 

-  "For  Kitty  ...  Launch  ...  2  A7E  A6E  ...(course)  2  3  5 . . . (speed) 

4  3  0  ...  (altitude)  1500" 

Fit.  Plan:  "Mission  Strike" 

Fit.  Plan:  "Proceed  position  ...  4  5  K  ...  1  1  5  -  2  0  E" 
Fit.  Plan:  "Load  ...  (equipment)  3  Shrik  ...  6  I1K82" 

Fit.  Plan:  "Stop" 

-  "Designate  Enemy  ...  (track)  E  E  0  0  5" 

-  "Display  ...  Place  Circle  Force  ...  M  P  6  1  5  (radius)  50" 

-  "For  V  A  0  1  0  ...Weapons  Free  Enery  All" 

-  "For  S  H  2  0  0  ...  Barrier  ...(position)  1  5-20  N  ...  125 
-  1  5  E  ...  (bearing)  135  ...  (distance)  4  5  ...  (using) 

5  S  Q  6  2  ...  (spacing)  4" 


NOTE:  Words  in  (parenthesis)  are  prompts  that  appear  cn  the 
speech  unit. 
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APR END IX  F 


NWISS/VERBEX  3000  USERS  GUIDE 


I :  TRCDUC'L  ICT  : 

This  users  cuice  v/as  prepared  tc  racilitete  cognizant  individuals 
in  training  their  individual  speech  patterns  to  the  Verbex  3G0C 
voice  terminal.  The  unit  has  a  maximum  vocabulary  capacity  lor 
360  words/utterances,  150  of  which  will  be  trained  in  order  tc 
interface  v;ar  gaming  scenarios  resiaent  on  the  VAX  11/780  computer. 

The  guioe  is  civided  into  the  two  (2)  separate  sections  that 
are  representative  of  each  actual  phase  of  training.  The  first 
phase  is  ENROLLMENT,  which  allows  each  word/utterance  tc  be 
individually  and  repeatedly  spoken.  The  second  phase  is  TRAINING, 
which  incorporates  the  repeated  use  of  the  phraseology  necessary 
for  wargame  scenario  interaction. 

What  follows  is  a  list  of  specific  procedures  used  tc  enable 
the  sytem  for  both  the  ENROLLMENT  and  TRAINING  phases  of  the 
voice  experiment: 


1.  The  machines  {Vertex,  ADM  31,  VT-102,  and  the  speech  unit)  are 
connected  using  the  proper  adapter  as  shown  in  Figure  *1.  (Figure 
#2  shows  the  configuration  to  run  NWISS  on  the  VERBEX  3000)  . 
The  small  machine  to  the  right  of  the  VT-102  has  "VERBEX 
3C00"  printed  on  the  top,  and  w ill  hereafter  be  referrec  tc 
as  the  "Speech  Unit",  so  as  to  not  be  confused  with  the  large 
VERBEX  3000  unit  located  just  to  the  left  of  the  table.  The 
following  specific  procedures  should  be  utilized  to  effect 
proper  set-up: 


A.  Turn  the  ADM  31,  VERBEX,  and  VT-102  to  the  power-on  position 
(see  Figure  #1 )  .  NOTE :  Turning  the  ADM  31  on  is  optional 
for  both  phases. 

E.  The  VT-10  2  and  the  speech  unit  will  automatically  run 
througn  a  self-test  (using  the  alphabet) .  Upon  completion 
of  this  procecure,  the  speech  unit  will  read:  "  Booting 
VERBEX  3000  ".  NOTE:  The  VT-102  screen  will  be  a  scrambled/ 
garbled  alphabet  on  occasion;  this  is  still  consioerec  to 
be  normal  operation  ano  will  not  effect  the  follcv-on 
VERBEX  enrollment/training  phases. 
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;  ow  complete  the  following  steps  to  enable  c  i !  &  system  : 

1.  Press  t:;e  SET-UP  key  on  the  VT-102. 

2.  Press  t;:e  Set  Up  A/3  (45)  key - to  set-up  "3". 

3.  Press  tne  Transr/it  Speec.  (~7)  key - press  sloe/',  enc. 

repeatec.lv  to  scroll  to  vjOO. 

4.  Press  the  Receive  Speed  (r8)  key - press  slowly  ar;c. 

repeatecly  to  scroll  to  4S00. 

5.  Press  the  SET-UP  key  to  exit. 

Hit  the  RETURN  KEY  (of  VT-102)  -  this  will  move  the 

cursor  to  the  left  side  of  the  screen. 

v’ith  the  cursor  on  the  left  side  of  the  (VT-102)  screen  enter 
the  following  commands  sequentially,  and  wait  for  the 
computer  to  respond  (as  shown  in  the  output  column) 
between  entries: 


ENTER 

dir  <return> 
ed  .asd 
n 

1,$P 


OUTPUT 

directory  listing 
to  use  the  edit  .asa  file 
to  number  lines 
to  print  lines 


If  NWISS  :w:/NWISS  is  on  line  1:  Enter  "  x  ",  and  continue 
with  step  letter  I. 

If  NV7ISS  :w:/NWISS  is  not  on  line  1,  enter: 

1.  2mO  (assuming  it  is  on  line  two) 

2.  l,$p 

3.  x  (  this  saves  the  new  order  ) 


The  prompt  on  tJp.e  VT-102  shoulo  be 
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(a  cash) 


I. 


With  a 


tl 


as  a  pror.pt,  enter: 


r.wiss/nv/iss 


J.  The  screen  should  reac: 

Monitor:  Version  2.0 
Ccpvrignt  (c)  1903,  Exxon  Cert. 

Galcon  3.3  -  Grasp  3.1 

ana  the  speech  unit  will  read:  "  Enter  user  ID  =  ". 


2.  From  the  speech  unit  enter  "  00  ",  then  press  the  enter  key. 
This  will  open  the  supervisor  mode.  ( NOTE :  the  Enter  Key  rust  be 
pressed  after  each  entry  from  the  key  pad  on  the  speech  unit) .  If 
you  realize  you  have  selected  an  incorrect  number  for  input  prior 
to  pressing  "  ENTER  ",  you  may  press  "  CLR  "  (the  bottom  right 
key  on  the  VERBEX  keyboard)  and  then  press  the  correct  number  to 
be  reentered.  The  "  Please  Wait  "  light  will  illuminate,  and 
after  a  minute  or  two  the  speech  unit  will  read:  "Add  New  User?". 

3.  You  will  no w  begin  to  scroll  through  Menu  #1  (see  Menu  Listings)  . 
Press  the  NO  button  to  scroll  through  the  Menu  for  familiarization 
purposes . 

4.  To  begin  the  ENROLLMENT  phase  (approx.  20  min.)  Press  YES' 
when  the  menu  reads  "Add  New  User?". 

5.  The  speech  unit  will  now  read  "Enter  New  User  ID  =".  Enter 
your  user  number  and  press  ENTER.  NOTE:  Be  sure  not  to  enter  a 
number  already  on  the  enclosed  list  of  used  number s .  (see  MENU 
GUIDE)  . 

6.  Put  the  Headset  on  with  the  Mike  on  the  left  side  (see  Figure 
t  3).  MIKE  POSITION  IS  CRITICAL  !!  Position  the  Mike  only  a 
little  to  the  left  of  center,  and  slightly  lov/er  than  the  center 
of  the  mouth.  It  should  be  no  more  than  1/2  inch  (i.e.  about  one 
thumbswiath)  from  the  lips  without  touching  them.  Per icciically 
check  the  microphone  for  proper  placement  in  order  to  insure 
consistency. 

7.  When  the  microphone  is  in  place  and  you  are  ready,  start  the 
amplifier  and  the  tape  deck  in  Bay  #2  (in  orcer  to  interject 
crowd  noise  at  65  db  into  the  training),  using  instructions 
attacheo  tc  the  tape  deck  itself. 

8.  The  speech  unit  will  prompt  you  to  "SET  the  GAIN". 

It  will  reaci  "Gain  Now  at  1,  Yes  to  Set  Gain". 

(NOTE:  A  gain  of  1-3  is  OK  —  under  normal  voice  levels,  a 
gain  of  2  -  3  will  be  maintainec  ). 
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9 .  When  reacy  tc  proceec,  cress  tne  YtS  button  anc.  per  i  orr..  ti  p 
following  steps: 


Follow  prcr.pt  (ie.  say  "One,  two,  tnree,  four, 
testing" ) . 

The  speech  unit  will  not'  rear;:  "Gain  is  set  to  (2-4), 
YES  to  set  gain". 

Press  the  YES  button. 

Follcv/  the  prompts  as  before. 

The  speech  unit  will  nov;  read:  "Gain  is  set  to  3,  YES  to 
set  gain". 

Press  the  YES  button. 

Eventually  the  speech  unit  will  reac:  "YES  to  sarple 
backrouno  ncise" . 

Press  the  YES  button. 

The  speech  unit  will  nov/  read:  "Remain  Silent".  At  this 
point  do  not  make  any  aoditional  ncise  other  than  normal 
breathing  (lasts  about  2-3  seconds) . 

The  speech  unit  will  read:  "Yes  to  sample  silence". 

Press  the  YES  button. 

The  speech  unit  will  no w  read:  "Remain  Silent".  Again, 
cc  not  make  any  aoditional  noise  while  it  is  sampling  the 
silence  cf  the  environment. 


The  speech  unit  will  nov;  read:  "Gain  =  (1-4).  YES  to 

proceed" . 


NOTE: 


If  the  gain  is  1-3,  do  not  press  YES  until  you  are  ready 
to  proceed  with  the  exercise.  Be  aware  that  the  STOP  button 
can  be  used  at  anytime  throughout  the  training  cycle  for 
one  of  three  (3)  possible  reasons: 

1.  If  you  would  just  like  to  take  a  break  for  a  few  minutes, 
press  the  STOP  button  and  you  will  be  prompted  to 
"Continue  Training?".  Sinply  press  YES  when  you  are 
ready  to  continue. 


2.  If  you  have  rr.ace  a  mistake  on  an  utterance,  press  the 
STOP  button.  Use  the  1-C  button  to  scroll  through  the 
r.'.er.u  (*2)  until  you  reac  "Reject  Last  Utterance?". 
Pressing  tne  YES  button  will  accept  that  ccr  ranc.  rrc. 
i: ec  iateiv  continue  with  the  next  v/crc  or  phrase. 

3.  If  you  feel  what  you  have  ocr.e  is  completely  unsal- 
vaceable  to  this  point,  press  STOP.  Scroll  car  cue;:: 
the  nenu  (»2)  until  veu  reac  "Logout?".  Press  YES, 
anc  if  you  are  in  the  ENROLLKEKT  phase,  continue  with 
Step  f-2.  If  you  are  in  the  TRAIMEG  phase,  continue 
with  Step  #  13  a. 

NOTES 

Get  comfortable  before  you  start.  Take  breaks  if  you  need  tner, 
and  strive  to  be  consistent  with  your  voice  modulation.  See 
Enclosure  i-  1  for  a  complete  list  of  the  words  you  will  see 
throughout  the  session.  The  words  will  be  in  order  of  appearance, 
and  the  "less  than  obvious"  annunciations  v/ill  be  annotated  for 
standardization  purposes. 

If  the  gain  =  4,  it  is  best  to  start  again.  One  way  to  do  this  is 
to  continue  as  normal  until  the  actual  cycle  has  started  prompting 
you  with  the  first  word  of  the  session.  At  this  point  press  the 
STOP  button  and  scroll  through  the  menu  until  you  reac  "Logout?". 
Press  YES.  The  speech  unit  will  read:  "Exit  (your  ID  i ) " ,  anc. 
will  then  read:  "Logout  supervisor",  followed  by:  "Enter  User 
ID".  Continue  from  Step  #2  using  your  same  initial  ID  number  when 
responding  to  the  "Add  hew  User?"  prompt. 

11.  Upon  completion  of  the  enrollment  phase  you  v/ill  see  "Enrollment 
Done.  YES  to  Save".  Push  the  YES  button  and  v/ait  for  the  "Patterns 
Savec.  YES  to  Train"  prompt  to  appear.  No w  push  the  following 
buttons  in  the  sequence  below: 

A.  Push  the  STOP  button. 

B.  "Resume  Enrollment?";  press  the  NO  button. 

C.  "Reject  Last  Utterance?";  press  the  NO  button. 

D.  "Save  Patterns?";  press  the  NO  button. 

E.  "Logout?";  press  the  YES  button. 

12.  This  concludes  the  ENROLLf-iENT  phase  of  the  individual  voice 
training  cycle. 
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13.  The  next  phase  is  TRAINING  and  it  includes  ten  (10)  different 
sections.  You  will  be  asked  to  train  different  combinations 
of  the  words  you  used  in  the  ENROLLMENT  phase.  The  names  anc. 


approximate  "time  to 

complete"  are 

listed 

below : 

A. 

nviSSGRAMl 

:  38  min. 

6. 

FIRE 

• 

17  min 

3. 

FORCE 

:  27  min 

7. 

SHIPORDEF 

• 

• 

24  min 

C. 

DISPLAY 

:  13  min 

8. 

AIRORDER 

• 

• 

31  min 

D. 

POSITION 

:  6  min. 

9. 

DIGITS 

• 

• 

S  min. 

E. 

TRACK 

:  7  min. 

10. 

LAUNCH 

• 

• 

32  min 

NOTE:  You  may  do  these  in  any  order. 


The  following  procedures  should  be  adhered  to  for  each  section  of 
the  TRAINING  phase: 

A.  When  the  speech  unit  reads:  "Enter  user  ID”,  you  v/ill 
enter:  "00".  This  procedure  logs  on  the  "supervisor" . 

B.  The  speech  unit  will  then  read  "Add  New  User?"  (as  part  of 
menu  #1) . 

C.  Scroll  through  the  menu  with  the  NC  button.  Stop  scrollinci 

at:  "Retrain  Cld  User?". 

D.  Fress  YES.  You  v/ill  now  be  prompted  for  your  ID 
number.  Enter  the  same  number  as  before.  The  speech  unit 
will  no v/  read:  "Loading  Patterns  for  user  ID  (your  ID  ;■)". 

E.  After  a  minute  or  so,  the  speech  unit  will  reac:  "All 
Grammars?".  Alv/ays  respond  by  pressing  the  NO  button. 

NOTE:  If  you  press  YES,  you  will  be  asking  for  a  long  exercise. 

F.  The  speech  unit  will  read  a  menu  (#4)  of  all  ten  (10) 
selections.  Scroll  through  it  with  the  NO  button  until 
you  find  a  section  you  v/ish  to  train. 

G.  When  you  find  it,  press  the  YES  button. 

H.  The  speech  unit  will  prompt  you  to  Set  the  Gain.  Do 
this  exactly  as  before  (Step  #  6).  Remember,  be  reaoy  to 
start  speaking  inuneoiately  after  pressing  the  YES  button 
in  response  to  the  "YES  to  proceed"  prompt.  Examples  of 
wore  combinations  are  listed  in  Enclosures  (2). 


I.  As  in  the  ENROLLMENT  phase,  you  will  be  able  to  use 
the  STOP  button  for  the  sane  reasons  as  stated  in 

Step  #10. 

J.  At  the  completion  of  each  of  the  ten  (10)  training  sections, 

the  speech  unit  will  react  "YES  to  save". 

K.  Press  trie  YES  button. 

L.  The  speech  unit  will  now  read:  "Patterns  Savec..  YES 

to  Test" . 

K.  Press  the  YES  button. 

**  MOTE  *♦  Test  Sessions: 

1.  For  each  completed  and  saved  training  section  (except 
"DISPLAY")  ,  you  will  be  prompted  to  say  one  word  or 
phrase;  usually  it  will  be  the  word  "Control_K". 
Respond  using  the  sane  annunciation  and  voice  modulation 
as  you  die  during  training.  The  speech  unit  will 
score  your  training  ability  on  a  scale  from  0  to  100. 
Acceptable  scores  range  from  80  to  100.  Lower  scores 
are  an  indication  that  possible  retraining  is  warrantee . 

2.  After  the  DISPLAY  section  is  completed  and  saved,  a 
similar  but  longer  test  will  be  given.  Each  response 
will  be  scored,  as  well  as  an  average  score  given  for 
that  particular  section.  The  test  will  take  about  1 
minute. 

14.  At  the  completion  of  each  test  session,  the  speech  unit  will 

reac:  "Score  =  _ .  YES  for  Menu". 

15.  Press  the  YES  button.  The  speech  unit  will  now  reac:  "Exits 
_ ",  then:  "Add  New  User?"  (Menu  #1). 

16.  At  this  point  if  you  woulc  like  to  continue  with  another 
section  of  the  TRAILING  Phase,  simply  scroll  through  the  Menu 
(using  the  MO  button)  until  the  speech  unit  reads:  "Retrain  Ole. 
User?".  Now  continue  with  step  13d. 

17.  If  instead  you  would  like  to  log-out  at  this  point,  scroll 

through  the  Menu  until  the  speech  unit  reads:  "Logout?".  Press 
the  YES  button.  The  speech  unit  will  now  read  (in  respective 
oroer):  "Exit  ID  (your  ID  #);  "Logout  supervisor"  ("00");  and 

"Enter  User  ID". 


18.  If  you  decide  to  continue  and  interface  with  the  NWISS 
wargair.ing  scenarios,  the  system  set-up  will  have  to  be  modified 
in  accordance  with  Figure  #2,  and  then  you  con  continue  with  step 


19.  To  shut  the  system  dcv.n,  singly  place  ail  of  tne  individual 
power  switches  (On/Off  switches)  to  the  OFF  position. 

20 .  with  the  VT-102  and  the  ADM  31  establish  the  initial  set-ut> 
as  per  procedure  1  (A-J)  .  The  speech  unit  shoulc.  now  read 
"Enter  User  ID:".  Enter  veur  ID  number  ano  cress  LETUP. 

21.  The  speech  unit  will  now  reac  "Loading  Patterns  for  ID  -  ", 

22.  You  car.  set  the  gain  (as  per  #8  -  1C  )  either  prior  to  or 
after  the  KKISS  is  brought  online. 

23.  Upon  completion  of  the  came,  press  the  STOP  button.  Scroll 
through  the  Menu  #3,  anc  folio w  steps  17  and  19. 


1.  Use  the  enclcsea  I'crclist  as  a  guice  while  going  through  the 
LI.RGLLIiEMT  Phase.  It  woulo  alsc  be  very  beneficial  to  nave  stud  ed¬ 
it  srior  to  attempting  the  rnase ,  as  the  words  are  presentee  toe 
fast  to  thin!;  about  pronunciation  prior  to  speaking  then. 

2.  Sit  comfortably;  preferably  cirectly  in  front  of  the  speech  unit. 

3.  Be  ready  to  push  the  STOP  button  if  you  make  a  mistake. 

4.  Study  the  were  list  (Enclosure  1)  prior  to  enrolling.  Especial] v 
consider  the  v/ords  in  the  "pronounce"  colunn.  Say  then  naturally. 
DO  MOT  pause  for  any  word  in  the  EKROLLMEMT  phase.  The  spaces  in 
that  colunn  are  to  help  determine  the  proper  annunciation  of  the 
word.  It  will  be  necessary  to  pause  in  the  TRAIN I MG  phase,  but 
only  long  enough  to  distinguish  between  v/ords. 

For  example,  ("FOR  KITTY"). 

5.  In  general,  use  the  nest  natural  pronunciation  that  comes  to 
mind. 

6.  Pronounce  numbers  which  appear  as  part  of  fixed  identifiers, 
in  a  natural  manner  (i.e.  F14A  as  F  Fourteen  A;  KK48  as  Hark 
Forty-Eight,  etc.). 

7.  Fully  pronounce  cigits  which  appear  as  part  of  variable  strings 
(i.e.  Altitude  250G  as  Altitude  Two  Five  Zero  Zero,  etc.). 

8.  Be  consistent  with  your  pronunciations. 

9.  The  Select  YES /MO  light: 

A.  This  light  is  on  the  console  of  the  speech  unit.  When  it 
is  illuminated  it  means  press  the  YES  or  MO  button  as 
applicable. 

B.  NOTE:  This  procedure  is  only  true  if  the  speech  unit 
reads  a  line  of  a  "  Menu  ".  At  all  other  times,  only  the 
YES  button  will  be  accepted. 
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MENU  GUIPE 


NOTE;  Do  net  use  the  tollcv/ing  list  cf  ID  numbers:  CO  tnrouen 
10  (inclusive) ,47,69  70  or  74 


MENU  #1 

Th.is  menu  is  invoked  by  entering 
the  supervisor  mode  (i.e.  00  into 
the  speech  unit) 


MENU  .n 

This  menu  is  invoked  by 
by  use  of  the  STOP 
button  within  ELRCLLbhliT 

Phase, 


Add  New  User? 

Test  Old  User? 
Re-Enroll  Ole  User? 
Re-Train  Old  User? 


I 


List  User? 


Resume  Enrollment? 
Reject  Last  Utterance? 

Save  Patterns? 
Logout? 


Delete  Ole  User? 
Logout? 


I 


MENU  «3  HBffl-li 

Invokes  by  cor.pleting  the  test  Invoked  by  cor.ir. encer.-.ent 

cession  in  tr.e  'TRAILING  phase  or  the  training 


Continue? 

Ml  Gram  a 

Calibrate? 

PVJI  SSI? 

Restart? 

Force? 

Logout? 

Display? 

Position? 

Track? 

Fire? 

Shiporcer? 

Airorder? 

Digits? 

Launch? 


WORD 

PBOKOUKCE 

WORD 

EBQBQ1HSCE 

1. 

Execute 

25.  Wilso 

WILSON 

2. 

BA  I  PAS  tv 

E  A  IP  ASW 

26.  Knox 

BOX 

3 . 

3CAF2 

BEECAF2 

27.  McCor 

»  cCCRi-.ICK 

4. 

ECAFl 

EEECAP1 

28.  Kitty 

KITTY 

5. 

F14STKCAP 

F  FOURTEEN 
STRIKECAP 

29.  VT’O 

VEL  TEL  ZLR 

30.  0 

ZERO 

6. 

A6STRIKE 

A  S IXSTRIKE 

31.  1 

7. 

Control_k 

32.  2 

8. 

Force 

33.  3 

9. 

Track 

34.  4 

10. 

Position 

35.  5 

11. 

Designate 

36.  6 

12. 

Neutral 

37.  7 

13. 

Friendly 

38.  8 

14. 

Enemy 

3S .  9 

NILE  (not 

15. 

Display 

40.  VSO 

VEE  S  ZERO 

16. 

Bearing 

41.  VHO 

VEE  H  ZERO 

17. 

For 

42.  VE1 

VEE  E  1 

18. 

1FOIIT1 

1.1 

43.  VEO 

VEE  E  ZERO 

19. 

Sprua 

SPRUANCE 

44.  VWO 

VEL  W  ZERO 

20. 

Misawa 

MI SAW A 

45.  VKO 

VEE  K  ZERO 

21. 

Losan 

LOS  ANGELES 

46.  VFO 

VEL  F  ZERO 

22. 

Rathb 

RATHBURK 

47.  VAO 

VEL  A  ZERO 

23. 

Omaha 

OMAHA 

48.  SHI 

SHI 

24.  Wichi 


WICHITA 


49.  MP6 


M  PEE  SIX 


50.  Viao 

77. 

3A0 

51.  Petro 

PETRO 

78. 

Tcr.ihk 

52.  Alexs 

79. 

Err:  on 

53.  Ronsa 

WARDSA 

80. 

Cruise 

54.  Erase 

81. 

ASROC 

55.  Plot 

82. 

I-K46A 

56 .  LOB 

LOB 

83. 

IiK46 

57.  ESM 

E  S  M 

84. 

MK  4  8 

58.  Sonar 

85. 

Torpedo 

86.  Drop 

86. 

At 

60.  Cancel 

87. 

Ranee 

61.  Grid 

88. 

Orders 

62.  Circle 

89. 

Take 

63.  XMAP.K 

X  ir.ark 

90. 

DECI'i 

64.  All 

91. 

Off 

65.  Place 

92. 

On 

66.  Center 

93. 

PBOCK 

67.  Radius 

94. 

Blip 

68.  - 

TACK 

95. 

Launch 

69.  N 

NORTH 

96. 

Weapons 

70.  E 

EAST 

97. 

Free 

71.  W 

WEST 

98. 

Subrar ine 

72.  S 

SOUTH 

99. 

Surface 

73.  BUO 

BEE  YOU  ZERO 

100. 

Air 

74.  BSO 

BEE  S  ZERO 

101. 

Tight 

75.  BPO 

BEE  P  ZERO 

1C  2. 

EMCON 

BEL  A,  ZERO 
TOM CHART. 

HARPOON 

AS  ROCK 

MARK  FORTY SIX  A 
MARK  FORTY  £■  IK 
MARK  FORTYFIGH1 

AT  (cne  word) 


D  E  C  I: 

AREOCK 


MCON 


76.  BEO 


BEE  E  ZERO 


103.  Surf 


SURF 


104 .  AIRS 


AIRS 


130.  SSC.62 


S  S  C  SINTYTNG 


1C  5.  A  El¬ 

A  f;  W 

131.  SSC53 

S  s  C  FIFTYTF.REE 

io  6.  Silers 

SILENT 

132.  SSC47 

S  S  C  FORTY  SIT,  LI. 

107.  F.aciia 

Rad I ati 

123.  A.6E 

A.  SIN  E 

ICO.  Fire 

134.  A.7E 

A  SEVEN  E 

109.  Station 

135.  E2C 

E  TOG  C 

110.  Periscope 

136.  EA3B 

E  A  THREE  B 

111.  Depth 

137.  EA6B 

E  A  SIX  B 

112.  Course 

138.  F14A 

F  FOURTEEN  A 

113.  Speed 

139.  F14T 

F  FOURTEEN  T 

114.  Proceed 

140.  KA6D 

K  A  SIX  D 

115.  Barrier 

141.  P3C 

PEE  THREE  CEE 

116.  Mission 

142.  S3A 

S  THREE  A 

117.  ASW 

ASW 

143.  SH3H 

S  b  THREE  H 

118.  SURCAP 

SIRCAP 

144.  SH2F 

S  R  TUG  F 

119.  Search 

145.  HARP 

HARP 

120.  CAP 

146.  MK82 

MARK  EIGHT  YTV-G 

121.  Airtanker 

147.  MK83 

MARK  E1GT1TYTHKEL 

122.  STFCAP 

STRIKECAF 

148.  HK84 

HARK  EIGHTYFOUR 

123.  Strike 

149.  Phenx 

PHEENIX 

124.  Cover 

150.  Shrik 

SHRIKE 

125.  Altitude 

151.  Spar 

SPARROW 

126.  Bingo 

152.  Swdr 

SIDEWINDER 

127.  Refuel 

153.  Walli 

WALLEYE 
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**  :  THE  ADAPTER  IS  STAMPED:  "  VERBEX  ONLY 

NOTE:  THE  DIAGRAM  DEPICTS  VIEWING  THE 
MACHINES  FROM  THE  REAR. 
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MICROPHONE  POSITION  IS  CRITICAL.  THE 
MICROPHONE  SHOULD  BE  NO  MORE  THAN  1/2 
INCH  FROM  THE  LIPS  WITHOUT  TOUCHING  THEM 
(I  E.  AS  SHOWN  IN  THE  FIGURE  ABOVE) 


THE  MICROPHONE  POSITION  SHOULD  BE  GX3IL? 

S2.S0SHS.tf  lower  than  the  center  of 
THE  MOUTH. 


APPENDIX  G 


MACINTOSH  MICROCOMPUTER  USERS  GUIDE 


The  purpose  ir.  accoiri.lishi.no  this  training  is  to  crcraro  tc 
clay  various  ih.'ISS  War game  Scenarios  as  an  Aircraft  C;ri:a 
Cattle  Group  Commander  curing  the  course  or  the  inoiviaual  re-ccrc 
trial.  Commands  for  the  gar.ie  will  be  entered  using  the  point 
select  method  tc  builc  acceptable  commands  in  the  place  cr  a 
conventional  keyboard. 

Tc  accomplish  the  necessary  training,  utilize  the  following 
steps  to  attempt  to  gain  some  skill  in  building  commands: 

1.  Reach  arouno  to  the  left  side  of  the  MAC,  anct  turn  it  on 
using  the  rocker  switch  on  the  upper  left  side  of  the  back.  Place 
the  mini-disk,  label  up,  in  the  slct  on  the  lower  right  cf  the 
front,  with  the  metal  tab  entering  the  slot  first.  (NOTE:  It  is 
not  necessary  to  open  the  tab  first  as  it  is  done  automatically 
by  the  drive.)  Wait  for  the  system  to  load  itself  (which  may  take 
a  little  over  a  minute) . 

2.  You  will  see  a  desk  top  v/ith  two  or  more  file  icons.  Using 
tne  mouse,  move  the  arrow  to  the  icon  labeled  "Offline  Training", 
ana  with  the  arrow  placed  anywhere  on  the  icon,  click  the  mouse 
button  twice.  The  program,  which  conditions  the  MAC  as  an  r .MTS'S 
terminal,  will  now  load  and  run  itself. 

3.  When  the  load  is  complete  you  v.ill  see  a  series  of  column 
headers  along  the  top  of  the  desk  top  (i.e.  "MR"  contains  numbers, 
etc.).  At  this  point  you  are  actually  corresponding  with  a. 
program  written  in  EASIC.  This  procram  provides  menus  cf  command 
worcs  from  a  limited  vocabulary.  It  supports  sequential  selection 
of  these  worcs  and  their  associated  display  (in  an  orderly  fashion 
on  the  screen)  in  order  to  allow  the  builo-up  of  full  commands. 
The  program  also  accomplishes  communications  with  the  VAX  and 
returns  information  from  the  VAX  to  the  screen;  sinilar  to  the 
output  provided  by  the  VT100  terminal.  To  select  a  word  from  a 
menu  use  the  mouse  to  position  the  arrow  on  the  menu  title  alcng 
the  top  of  the  screen,  push  dcv/n  the  mouse  button,  and  hold  it 
down.  The  menu  will  extend  downward  in  its  own  window  (see  the 
attached  example  menus).  Continue  to  held  the  mouse  button  oown 
while  you  move  the  mouse  to  position  the  arrow  on  the  wore  of 
your  choice.  When  the  arrow  is  ever  each  word  it  will  be  highlighted. 
To  select  one  of  the  words  simply  let  up  on  the  button.  The 
window  will  disappear  and  the  word  will  be  Displayed  on  the  cesk 
top.  When  a  command  is  completer  move  to  the  right-most  column 
and  select  "EXECUTE  ORDER"  from  this  menu.  The  VAX  will  respond 
to  the  oraer  when  the  system  is  "on-line"  in  the  future,  but 
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realistic  practice  sessions  can  still  be  obtained  in  the  "off-line" 
r.:cce . 


4.  Notice  that  the  richt-most  menu  contains  a  selection  icr 
"XANUAL  FI  TRY".  This  allows  you  to  type  in  the  wo  res  that  arc 
otnerv. ise  not  on  the  menus.  The  key  under  your  left  us  lr  with  an 
infinity  sign  is  the  control  key.  Use  the  delete  key  to  back  cur 

rrors  in  this  roae.  Cnee  you  have  selected  this  r.ode  ,  you  rust 
hen  type  your  desireo  v/crc  and  cicse  the  session  vita  an 
which  will  take  you  back  to  nouse  control.  Now  "EXECUTE  Cl. ’FEE" 
must  be  selected  fron  the  last  menu  in  order  to  complete  the  corrano. 

5.  To  terminate  the  session,  select  "OUIT  PFOGRAI-. "  on  tne 
right  most  menu.  At  the  next  window  under  the  FILE  menu  select 
"QUIT",  and  under  the  next  window  under  the  FILE  menu  select 
"EJECT".  When  the  ir.ini-tloppy  disk  is  ejected,  turn  the  machine 
off  with  the  switch  in  the  back. 
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AIRCRAFT 1  MENU 


ENCLOSURE  4 
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WEAPONS  FREE  _ 

...  All  _ 

...  AIR 
...  SUREACE 
...  SUBMARINE 
ENEMY 

tire  „ 

...  HAPON  CRUISE 
„.  MK48  IOAPEOO 
...  ASAOC  IORPEOO  . 
...  TAKE  ... 

...  BRO _ 

...  BED _ 

...  BPO  _  ... 

...  BSO _  ... 

...  BUO  _  ... 

...  BERRINC... 

...  RANGE  ... 

HEtP  M! 


WEAPONS/TRACK  MENU 
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DESIG  FRIENDLY  ... 
DESI6  NEUTRAL  _ 
DESIG  UNKNOWN  ... 
RT  _ 

...  RLEKSKEYEU 
™  PETROPRULOUSK 
...  WONSON 
_.  ULROIUOSTOK 


DESIGNATING  TARGET  MENU 
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CONTROL  MENU 
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